00000001:02000400:3.0F:1788842937.435991:0:2960:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788842957.119863:0:3181:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788842958.542215:0:3224:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 931 MB/s 00000001:01000000:3.0:1788842958.791573:0:3224:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1187 MB/s 00000001:01000000:2.0:1788842959.041540:0:3224:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 6319 MB/s 00000020:02000000:0.0:1788842959.762607:0:3273:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_112_g92cfe64 00000400:02000000:2.0:1788842960.595090:0:3288:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.129@tcp [8/256/0/180] 00008000:02000000:0.0:1788842964.428236:0:3437:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0F:1788843016.113425:0:5241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788843030.139642:0:5827:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788843030.139648:0:5827:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788843030.139747:0:5827:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000946c18df 00000080:02000400:0.0:1788843030.139759:0:5827:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:0.0:1788843030.156898:0:5827:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:0.0:1788843030.156917:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788843030.156970:0:5827:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000cca758fc) 00000020:00000080:0.0:1788843030.156997:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788843030.209498:0:5827:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788843030.210263:0:5827:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788843030.228567:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788843030.228612:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788843030.228628:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788843030.228668:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788843030.228687:0:5827:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788843030.229075:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788843030.229084:0:5827:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788843030.229095:0:5827:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b0914988 00000020:01000004:2.0:1788843030.229101:0:5827:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788843030.229106:0:5827:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788843030.229110:0:5827:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000946c18df from MGS 00000020:01000004:2.0:1788843030.229115:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788843030.229132:0:5827:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000df9af605) 00000020:00000080:2.0:1788843030.229143:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788843030.229610:0:5827:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000946c18df from MGS, refs=2 00080000:01000000:2.0:1788843030.229616:0:5827:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788843030.229626:0:5827:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b0914996 00000100:00100000:2.0:1788843030.229743:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788843030.229927:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788843030.229934:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788843030.238003:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788843030.238027:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788843030.241545:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843030.242110:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788843030.242116:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788843030.251626:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788843030.251652:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788843030.256624:0:5827:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788843030.256638:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788843030.257796:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843030.257800:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843030.257802:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843030.263156:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843030.263165:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843030.263167:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843030.269612:0:5827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788843030.277958:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788843030.517488:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4231 MB/s 00000001:01000000:3.0:1788843030.767403:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 6807 MB/s 00000001:01000000:3.0:1788843031.017561:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 691 MB/s 00000001:01000000:2.0:1788843031.268216:0:5827:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1035 MB/s 00080000:10000000:2.0:1788843031.283437:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1788843031.301514:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788843031.318800:0:5827:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788843031.318818:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788843031.318821:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788843031.321031:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788843031.321164:0:5827:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788843031.321458:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788843031.322013:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788843031.322048:0:5827:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788843031.322564:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843031.322814:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788843031.322823:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788843031.325991:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788843031.326011:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788843031.326528:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788843031.326535:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788843031.329361:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788843031.329399:0:5827:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.129@tcp' 00000020:01000004:1.0:1788843031.329401:0:5827:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788843031.329686:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.129@tcp (typ=mgc) 00000020:00000080:1.0:1788843031.329713:0:5827:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.129@tcp (000000005a6681b7) 00000020:00000080:1.0:1788843031.329738:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788843031.329866:0:5827:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f252e86e@MGC192.168.203.129@tcp: add connection 192.168.203.129@tcp at head 00010000:00010000:1.0:1788843031.330081:0:5827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.129@tcp-0 is initialized 00000040:01000000:1.0:1788843031.330089:0:5827:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788843031.336910:0:5843:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788843031.337678:0:5844:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788843031.337748:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.129@tcp (uuid 28cf63da-daee-485f-b466-4ec68876f732) 00000020:00000080:1.0:1788843031.337783:0:5827:0:(genops.c:1385:class_connect()) connect: client 28cf63da-daee-485f-b466-4ec68876f732, cookie 0xc6b8ac1b09149a4 00000100:00080000:1.0:1788843031.337799:0:5827:0:(import.c:510:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788843031.337806:0:5827:0:(import.c:624:import_select_connection()) MGC192.168.203.129@tcp: import 00000000f252e86e using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1788843031.337869:0:5827:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000005a31d56c x1875737795625088/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843031.337903:0:5827:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 28cf63da-daee-485f-b466-4ec68876f732->MGS 00000020:01000004:1.0:1788843031.337930:0:5827:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788843031.337936:0:5827:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788843031.337955:0:5827:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000046676852) 00000020:00000080:1.0:1788843031.337970:0:5827:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788843031.338532:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005a31d56c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:28cf63da-daee-485f-b466-4ec68876f732:3303:1875737795625088:0@lo:250: 00000100:00100000:3.0:1788843031.338670:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843031.338759:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795625088 00000100:00100000:2.0:1788843031.338772:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795625088 00000100:00100000:2.0:1788843031.338826:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843031.338838:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2b0db9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1875737795625088:12345-0@lo:250: 00010000:00080000:2.0:1788843031.338873:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 28cf63da-daee-485f-b466-4ec68876f732@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:2.0:1788843031.338908:0:5839:0:(genops.c:1385:class_connect()) connect: client 28cf63da-daee-485f-b466-4ec68876f732, cookie 0xc6b8ac1b09149b2 00000100:00080000:2.0:1788843031.339066:0:5839:0:(import.c:65:import_set_state_nolock()) 0000000095d980ae : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843031.339186:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2b0db9f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+5:3303:x1875737795625088:12345-0@lo:250: Request processed in 349us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843031.339194:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843031.340010:0:3303:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788843031.340027:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.129@tcp: connect to target with instance 0 00000100:00080000:3.0:1788843031.340037:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788843031.340043:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788843031.340048:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000f252e86e MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788843031.340052:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788843031.340071:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788843031.340079:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005a31d56c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:28cf63da-daee-485f-b466-4ec68876f732:3303:1875737795625088:0@lo:250: 00000100:00100000:0.0:1788843031.360313:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788843031.360927:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788843031.360937:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788843031.365994:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788843031.366012:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788843031.366727:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788843031.366737:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788843031.368845:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843031.370328:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788843031.370743:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788843031.372934:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788843031.373201:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788843031.455927:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843031.456214:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788843031.456220:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788843031.460373:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788843031.460402:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788843031.461178:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843031.461477:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788843031.461491:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788843031.462307:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788843031.462316:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788843031.464839:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843031.465111:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788843031.465118:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788843031.470420:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788843031.470455:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788843031.483079:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843031.483474:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788843031.483480:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788843031.486442:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788843031.486455:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788843031.533683:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788843031.534018:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788843031.534025:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788843031.538975:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788843031.538991:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788843031.541043:0:5827:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788843031.541056:0:5827:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788843031.542673:0:5827:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788843031.542698:0:5827:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788843031.542704:0:5827:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788843031.542832:0:5827:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788843031.542876:0:5827:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.129@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1788843031.542880:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788843031.542881:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788843031.542883:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843031.542884:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843031.542885:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843031.542886:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843031.542887:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788843031.542888:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788843031.542890:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788843031.542891:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788843031.542892:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843031.542893:0:5827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788843031.542896:0:5827:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1788843031.542898:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788843031.542899:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788843031.542900:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843031.542901:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843031.542902:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843031.542903:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843031.542904:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788843031.542905:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788843031.542906:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788843031.542907:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788843031.542908:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843031.542909:0:5827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788843031.542936:0:5827:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788843031.542954:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd0819a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795625216:0@lo:253: 00000100:00100000:1.0:1788843031.543024:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843031.543138:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000434bce77 going to sleep for 11 seconds 00000100:00100000:3.0:1788843031.543336:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795625216 00000100:00100000:3.0:1788843031.543484:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795625216 00000100:00100000:3.0:1788843031.543580:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843031.543592:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009488ec32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+5:5827:x1875737795625216:12345-0@lo:253: 20000000:01000000:3.0:1788843031.543639:0:5841:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788843031.543642:0:5841:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788843031.545215:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788843031.545382:0:5841:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1788843031.545724:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843031.546943:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788843031.547878:0:5841:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788843031.547883:0:5841:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788843031.547890:0:5841:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788843031.547893:0:5841:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788843031.547909:0:5841:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1788843031.565655:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843031.565915:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1788843031.565931:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788843031.565977:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788843031.566025:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788843031.566063:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788843031.568435:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788843031.568471:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788843031.568549:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788843031.568558:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788843031.568592:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788843031.568600:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788843031.568631:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788843031.568682:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788843031.568738:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788843031.568743:0:5841:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788843031.568755:0:5841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843031.568932:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788843031.568941:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788843031.568972:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788843031.569003:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788843031.569044:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788843031.569054:0:5841:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788843031.572412:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788843031.572441:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788843031.573024:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788843031.573074:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788843031.573115:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788843031.573132:0:5841:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788843031.573408:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788843031.573417:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788843031.573447:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788843031.573484:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788843031.573900:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788843031.573954:0:5841:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788843031.573961:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788843031.574764:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788843031.588714:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788843031.588746:0:5841:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.129@tcp for mdt 20000000:01000000:3.0:1788843031.588749:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:3.0:1788843031.588790:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788843031.588800:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788843031.588832:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788843031.588841:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:3.0:1788843031.588886:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788843031.588896:0:5841:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788843031.588927:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788843031.588958:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788843031.589040:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788843031.589043:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788843031.589047:0:5841:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788843031.589068:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788843031.589071:0:5841:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788843031.589101:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788843031.589103:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788843031.589994:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788843031.590634:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788843031.590677:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788843031.590739:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1788843031.590752:0:5841:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788843031.590754:0:5841:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788843031.591194:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788843031.591520:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788843031.591739:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788843031.591782:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1788843031.591796:0:5841:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788843031.591798:0:5841:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788843031.591802:0:5841:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788843031.591804:0:5841:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788843031.591809:0:5841:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788843031.591814:0:5841:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788843031.592386:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788843031.592675:0:5841:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788843031.604934:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788843031.604994:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788843031.606602:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788843031.606642:0:5841:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788843031.606666:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f0e5b038/0xc6b8ac1b09149b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843031.606681:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f0e5b038/0xc6b8ac1b09149b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843031.606691:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f0e5b038/0xc6b8ac1b09149b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843031.606696:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f0e5b038/0xc6b8ac1b09149b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843031.606703:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f0e5b038/0xc6b8ac1b09149b9 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843031.606709:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f0e5b038/0xc6b8ac1b09149b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843031.606715:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f0e5b038 already unused, calling callback (000000003fad23fd) 00010000:00010000:2.0:1788843031.606718:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f0e5b038/0xc6b8ac1b09149b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843031.606742:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f0e5b038/0xc6b8ac1b09149b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843031.606755:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f0e5b038/0xc6b8ac1b09149b9 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843031.606762:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f0e5b038/0xc6b8ac1b09149b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843031.606767:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f0e5b038/0xc6b8ac1b09149b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788843031.606783:0:5841:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788843031.930108:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009488ec32 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+5:5827:x1875737795625216:12345-0@lo:253: Request processed in 386511us (387077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843031.930122:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843031.930256:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd0819a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795625216:0@lo:253: 10000000:01000000:1.0:1788843031.930273:0:5827:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788843031.930276:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788843031.930277:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788843031.930279:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843031.930280:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788843031.930281:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843031.930282:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843031.930284:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788843031.930285:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788843031.930286:0:5827:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788843031.930288:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843031.930289:0:5827:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788843031.930309:0:5827:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000946c18df from lustre-MDT0000 10000000:01000000:1.0:1788843031.930334:0:5827:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788843031.930337:0:5827:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788843031.930360:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8dab600719b8 10000000:01000000:1.0:1788843031.930366:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788843031.930374:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dab600719b8 from 1 10000000:01000000:1.0:1788843031.930376:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788843031.930410:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000c87a0644/0xc6b8ac1b09149c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843031.930420:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000c87a0644/0xc6b8ac1b09149c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843031.930428:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000c87a0644/0xc6b8ac1b09149c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843031.930444:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd0819a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795625344:0@lo:101: 00000100:00100000:1.0:1788843031.930482:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843031.930530:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000342ccf3b going to sleep for 11 seconds 00000100:00100000:2.0:1788843031.931207:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795625344 00000100:00100000:2.0:1788843031.931215:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795625344 00000100:00100000:2.0:1788843031.931272:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843031.931281:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c87ba3ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+5:5827:x1875737795625344:12345-0@lo:101: 00010000:00010000:2.0:1788843031.931294:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843031.931309:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f0e5b038/0xc6b8ac1b09149c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b09149c0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843031.931331:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f0e5b038/0xc6b8ac1b09149c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b09149c0 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843031.931369:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f0e5b038/0xc6b8ac1b09149c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b09149c0 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843031.931396:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f0e5b038, rc 0) 00000100:00100000:2.0:1788843031.931435:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c87ba3ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+6:5827:x1875737795625344:12345-0@lo:101: Request processed in 156us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843031.931441:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788843031.931550:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd0819a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795625344:0@lo:101: 00010000:00010000:1.0:1788843031.931579:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000c87a0644/0xc6b8ac1b09149c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09149c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843031.931587:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000c87a0644/0xc6b8ac1b09149c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b09149c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843031.931635:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd0819a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795625472:0@lo:501: 00000100:00100000:1.0:1788843031.931750:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843031.931778:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000342ccf3b going to sleep for 11 seconds 00000100:00100000:2.0:1788843031.931824:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795625472 00000100:00100000:2.0:1788843031.931828:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795625472 00000100:00100000:2.0:1788843031.931856:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788843031.931861:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d677fec8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+6:5827:x1875737795625472:12345-0@lo:501: 00000100:00100000:2.0:1788843031.932081:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d677fec8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+6:5827:x1875737795625472:12345-0@lo:501: Request processed in 220us (330us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843031.932088:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843031.932189:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd0819a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795625472:0@lo:501: 10000000:01000000:1.0:1788843031.932209:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788843031.932226:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 00000000c87a0644/0xc6b8ac1b09149c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09149c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843031.932233:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 00000000c87a0644/0xc6b8ac1b09149c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09149c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843031.932250:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dab71a20000 10000000:01000000:1.0:1788843031.932254:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788843031.932258:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dab71a20000 10000000:01000000:1.0:1788843031.932261:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788843031.932263:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dab71a20000 from 1 10000000:01000000:1.0:1788843031.932265:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788843031.932281:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000009d1e868b/0xc6b8ac1b09149ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843031.932288:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000009d1e868b/0xc6b8ac1b09149ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843031.932307:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000009d1e868b/0xc6b8ac1b09149ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843031.932318:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd0819a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795625600:0@lo:101: 00000100:00100000:1.0:1788843031.932365:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843031.932381:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000342ccf3b going to sleep for 11 seconds 00000100:00100000:3.0:1788843031.932425:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795625600 00000100:00100000:3.0:1788843031.932429:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795625600 00000100:00100000:3.0:1788843031.932457:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843031.932463:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a4f74c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+6:5827:x1875737795625600:12345-0@lo:101: 00010000:00010000:3.0:1788843031.932470:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843031.932480:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a2cbeeec/0xc6b8ac1b09149d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b09149ce expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843031.932493:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a2cbeeec/0xc6b8ac1b09149d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b09149ce expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843031.932511:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a2cbeeec/0xc6b8ac1b09149d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b09149ce expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843031.932517:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a2cbeeec, rc 0) 00000100:00100000:3.0:1788843031.932544:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a4f74c2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+7:5827:x1875737795625600:12345-0@lo:101: Request processed in 82us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843031.932550:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843031.932668:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd0819a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795625600:0@lo:101: 00010000:00010000:1.0:1788843031.932678:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000009d1e868b/0xc6b8ac1b09149ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09149d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843031.932684:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000009d1e868b/0xc6b8ac1b09149ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b09149d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843031.932693:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788843031.932695:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000009d1e868b/0xc6b8ac1b09149ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09149d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843031.932700:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000009d1e868b/0xc6b8ac1b09149ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09149d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843031.932705:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788843031.932708:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788843031.932711:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dab71a20000 10000000:01000000:1.0:1788843031.932713:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788843031.932716:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788843031.932717:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788843031.932728:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000001263271b/0xc6b8ac1b09149dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843031.932743:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000001263271b/0xc6b8ac1b09149dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843031.932750:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000001263271b/0xc6b8ac1b09149dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843031.932761:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000dd0819a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795625728:0@lo:101: 00000100:00100000:1.0:1788843031.932785:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843031.932937:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 00000000342ccf3b going to sleep for 11 seconds 00000100:00100000:3.0:1788843031.934926:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795625728 00000100:00100000:3.0:1788843031.934938:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795625728 00000100:00100000:3.0:1788843031.935035:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843031.935044:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa5242a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+7:5827:x1875737795625728:12345-0@lo:101: 00010000:00010000:3.0:1788843031.935059:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843031.935074:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000073dfb1b0/0xc6b8ac1b09149e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b09149dc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843031.935096:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000073dfb1b0/0xc6b8ac1b09149e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b09149dc expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843031.935106:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000073dfb1b0/0xc6b8ac1b09149e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b09149dc expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843031.935113:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000073dfb1b0, rc 0) 00000100:00100000:3.0:1788843031.935188:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa5242a2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+8:5827:x1875737795625728:12345-0@lo:101: Request processed in 146us (2402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843031.935195:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843031.936975:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000dd0819a3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795625728:0@lo:101: 00010000:00010000:2.0:1788843031.937000:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000001263271b/0xc6b8ac1b09149dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09149e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843031.937011:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000001263271b/0xc6b8ac1b09149dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b09149e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843031.937100:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014fed687 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795625856:0@lo:501: 00000100:00100000:2.0:1788843031.937152:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843031.937193:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099d89048 going to sleep for 11 seconds 00000100:00100000:1.0:1788843031.937279:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795625856 00000100:00100000:1.0:1788843031.937286:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795625856 00000100:00100000:1.0:1788843031.937317:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843031.937323:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dbfd3c3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+8:5827:x1875737795625856:12345-0@lo:501: 00000100:00100000:1.0:1788843031.937586:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dbfd3c3b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+9:5827:x1875737795625856:12345-0@lo:501: Request processed in 262us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843031.937593:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788843031.937681:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014fed687 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795625856:0@lo:501: 00000100:00100000:2.0:1788843031.937709:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014fed687 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795625984:0@lo:503: 00000100:00100000:2.0:1788843031.937743:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843031.937769:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000099d89048 going to sleep for 11 seconds 00000100:00100000:1.0:1788843031.937873:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795625984 00000100:00100000:1.0:1788843031.937877:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795625984 00000100:00100000:1.0:1788843031.937894:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843031.937899:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5721958 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+9:5827:x1875737795625984:12345-0@lo:503: 00000100:00100000:1.0:1788843031.938037:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5721958 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+9:5827:x1875737795625984:12345-0@lo:503: Request processed in 137us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843031.938044:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788843031.938121:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014fed687 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795625984:0@lo:503: 00000100:00100000:2.0:1788843031.938600:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014fed687 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:5869:1875737795626112:0@lo:502: 00000100:00100000:2.0:1788843031.938635:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843031.938670:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set 0000000091140ffc going to sleep for 11 seconds 00000100:00100000:1.0:1788843031.938772:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795626112 00000100:00100000:1.0:1788843031.938776:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795626112 00000100:00100000:1.0:1788843031.938805:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843031.938811:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000013a77a5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+9:5869:x1875737795626112:12345-0@lo:502: 00000100:00100000:1.0:1788843031.938965:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000013a77a5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+9:5869:x1875737795626112:12345-0@lo:502: Request processed in 154us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843031.938971:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788843031.939073:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014fed687 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:5869:1875737795626112:0@lo:502: 00000020:01000000:2.0:1788843031.939095:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843031.939105:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843031.939107:0:5869:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788843031.939113:0:5869:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788843031.939117:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788843031.939129:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000bf9237e6) 00000020:00000080:2.0:1788843031.939144:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788843031.939149:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788843031.939223:0:5869:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788843031.939229:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b09149f1 00000020:00000080:2.0:1788843031.939854:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788843031.939860:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843031.939863:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843031.939865:0:5869:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788843031.939868:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843031.939871:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843031.939873:0:5869:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788843031.939877:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788843031.939887:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000035e00a6d) 00000020:00000080:2.0:1788843031.939899:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788843031.939902:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788843031.939903:0:5869:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788843031.939906:0:5869:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788843031.939911:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788843031.939959:0:5869:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000946c18df from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788843031.939971:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000ef328a80) 00000020:00000080:2.0:1788843031.939986:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788843031.940046:0:5869:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788843031.940052:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b8ac1b0914a06 00000020:00000080:2.0:1788843031.940134:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788843031.940140:0:5869:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788843031.940144:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc6b8ac1b0914a0d 00080000:01000000:2.0:1788843031.940148:0:5869:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788843031.940151:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b0914a14 00080000:10000000:2.0:1788843031.940954:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788843031.941189:0:5869:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1788843031.948822:0:5869:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788843032.002576:0:5869:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788843032.002989:0:5869:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788843032.005167:0:5869:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788843032.005497:0:5869:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788843032.027290:0:5869:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ecd06f8a) 00000020:00000080:3.0:1788843032.027312:0:5869:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788843032.027421:0:5869:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788843032.027429:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b0914a22 00000020:00000080:1.0:1788843032.033262:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1788843032.038091:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788843032.096863:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788843032.186090:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788843032.270904:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00010000:00010000:0.0:1788843032.324739:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788843032.405933:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788843032.514484:0:5869:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788843032.589569:0:5869:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc6b8ac1b0914a29 00000020:00000080:2.0:1788843032.590145:0:5869:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788843032.590157:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843032.590164:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843032.590166:0:5869:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788843032.590169:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843032.590173:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843032.590174:0:5869:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788843032.590177:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788843032.590178:0:5869:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788843032.590181:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843032.590183:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843032.590184:0:5869:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788843032.590186:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843032.590190:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843032.590191:0:5869:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788843032.590194:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788843032.590253:0:5869:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788843032.590317:0:5869:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000014fed687 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:5869:1875737795626240:0@lo:502: 00000100:00100000:2.0:1788843032.590567:0:5869:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843032.590631:0:5869:0:(client.c:2715:ptlrpc_set_wait()) set 0000000042e68584 going to sleep for 11 seconds 00000100:00100000:3.0:1788843032.590740:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795626240 00000100:00100000:3.0:1788843032.590748:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795626240 00000100:00100000:3.0:1788843032.590785:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788843032.590793:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000946eba1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+9:5869:x1875737795626240:12345-0@lo:502: 00000100:00100000:3.0:1788843032.591205:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000946eba1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+9:5869:x1875737795626240:12345-0@lo:502: Request processed in 412us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843032.591214:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843032.591531:0:5869:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000014fed687 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:5869:1875737795626240:0@lo:502: 00000020:01000000:2.0:1788843032.591557:0:5869:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843032.591563:0:5869:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843032.591565:0:5869:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788843032.591569:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788843032.591849:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788843032.591869:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788843032.591890:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000001263271b/0xc6b8ac1b09149dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09149e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843032.591902:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000001263271b/0xc6b8ac1b09149dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09149e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843032.591910:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dab71a20000 from 1 10000000:01000000:3.0:1788843032.591912:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788843032.591959:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000fdfc63d1/0xc6b8ac1b0914a30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843032.591967:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000fdfc63d1/0xc6b8ac1b0914a30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843032.591976:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000fdfc63d1/0xc6b8ac1b0914a30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843032.591999:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c57c06fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795626368:0@lo:101: 00000100:00100000:3.0:1788843032.592041:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843032.592078:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000008021a28 going to sleep for 11 seconds 00000100:00100000:1.0:1788843032.592189:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795626368 00000100:00100000:1.0:1788843032.592195:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795626368 00000100:00100000:1.0:1788843032.592259:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788843032.592267:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d1a0e60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+9:5827:x1875737795626368:12345-0@lo:101: 00010000:00010000:1.0:1788843032.592278:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843032.592292:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000033823beb/0xc6b8ac1b0914a37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914a30 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.592313:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000033823beb/0xc6b8ac1b0914a37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914a30 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.592321:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000033823beb/0xc6b8ac1b0914a37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914a30 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.592328:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000033823beb, rc 0) 00000100:00100000:1.0:1788843032.592377:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d1a0e60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+10:5827:x1875737795626368:12345-0@lo:101: Request processed in 111us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843032.592382:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788843032.592706:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c57c06fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795626368:0@lo:101: 00010000:00010000:3.0:1788843032.592719:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000fdfc63d1/0xc6b8ac1b0914a30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914a37 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843032.592728:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000fdfc63d1/0xc6b8ac1b0914a30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914a37 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843032.593505:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c57c06fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795626496:0@lo:256: 00000100:00100000:3.0:1788843032.593557:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843032.593640:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000008021a28 going to sleep for 11 seconds 00000100:00100000:1.0:1788843032.594061:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795626496 00000100:00100000:1.0:1788843032.594068:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795626496 00000100:00100000:1.0:1788843032.594116:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788843032.594124:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ddcc7ea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+10:5827:x1875737795626496:12345-0@lo:256: 20000000:01000000:1.0:1788843032.594150:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788843032.594156:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788843032.594588:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ddcc7ea4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+10:5827:x1875737795626496:12345-0@lo:256: Request processed in 463us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843032.594598:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788843032.594682:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c57c06fc pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795626496:0@lo:256: 10000000:01000000:0.0:1788843032.595952:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788843032.595981:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 00000000fdfc63d1/0xc6b8ac1b0914a30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914a37 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843032.595994:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 00000000fdfc63d1/0xc6b8ac1b0914a30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914a37 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843032.596015:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab71a20000 from 1 10000000:01000000:0.0:1788843032.596018:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843032.596072:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000001fcc3402/0xc6b8ac1b0914a3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843032.596079:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000001fcc3402/0xc6b8ac1b0914a3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843032.596089:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000001fcc3402/0xc6b8ac1b0914a3e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843032.596296:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008466f0e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795626624:0@lo:101: 00000100:00100000:0.0:1788843032.596424:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843032.596458:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019aa96b6 going to sleep for 11 seconds 00000100:00100000:1.0:1788843032.596571:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795626624 00000100:00100000:1.0:1788843032.596578:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795626624 00000100:00100000:1.0:1788843032.596669:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788843032.596677:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058f4b72f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+10:5827:x1875737795626624:12345-0@lo:101: 00010000:00010000:1.0:1788843032.596690:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843032.596702:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000019a76543/0xc6b8ac1b0914a45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914a3e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.596724:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000019a76543/0xc6b8ac1b0914a45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914a3e expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.596734:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000019a76543/0xc6b8ac1b0914a45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914a3e expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.596742:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000019a76543, rc 0) 00000100:00100000:1.0:1788843032.596798:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058f4b72f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+11:5827:x1875737795626624:12345-0@lo:101: Request processed in 122us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843032.596805:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788843032.597061:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008466f0e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795626624:0@lo:101: 00010000:00010000:0.0:1788843032.597075:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000001fcc3402/0xc6b8ac1b0914a3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914a45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843032.597083:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000001fcc3402/0xc6b8ac1b0914a3e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914a45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843032.597146:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008466f0e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795626752:0@lo:501: 00000100:00100000:0.0:1788843032.597172:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843032.597194:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019aa96b6 going to sleep for 11 seconds 00000100:00100000:1.0:1788843032.597370:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795626752 00000100:00100000:1.0:1788843032.597375:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795626752 00000100:00100000:1.0:1788843032.597393:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788843032.597398:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003c1e5a9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+11:5827:x1875737795626752:12345-0@lo:501: 00000100:00100000:1.0:1788843032.598184:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003c1e5a9d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+11:5827:x1875737795626752:12345-0@lo:501: Request processed in 784us (1009us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843032.598193:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788843032.598517:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008466f0e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795626752:0@lo:501: 00000100:00100000:0.0:1788843032.598760:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008466f0e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795626880:0@lo:503: 00000100:00100000:0.0:1788843032.598814:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843032.598838:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019aa96b6 going to sleep for 11 seconds 00000100:00100000:1.0:1788843032.598884:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795626880 00000100:00100000:1.0:1788843032.598894:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795626880 00000100:00100000:1.0:1788843032.598986:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788843032.598993:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027977feb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+11:5827:x1875737795626880:12345-0@lo:503: 00000040:00080000:1.0:1788843032.599029:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788843032.599357:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027977feb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+11:5827:x1875737795626880:12345-0@lo:503: Request processed in 346us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843032.599366:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788843032.599744:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008466f0e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795626880:0@lo:503: 00000040:00080000:2.0:1788843032.601215:0:5873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788843032.601557:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788843032.601579:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788843032.601627:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000001fcc3402/0xc6b8ac1b0914a3e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914a45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843032.601638:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000001fcc3402/0xc6b8ac1b0914a3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914a45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843032.601769:0:5827:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788843032.601772:0:5827:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dab71a20000 10000000:01000000:0.0:1788843032.601775:0:5827:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dab71a20000 10000000:01000000:0.0:1788843032.601779:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788843032.601784:0:5827:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dab71a20000 from 1 10000000:01000000:0.0:1788843032.601786:0:5827:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788843032.601821:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000009c35eb55/0xc6b8ac1b0914a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843032.601828:0:5827:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000009c35eb55/0xc6b8ac1b0914a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843032.601838:0:5827:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000009c35eb55/0xc6b8ac1b0914a4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843032.601856:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008466f0e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795627008:0@lo:101: 00000100:00100000:0.0:1788843032.601986:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843032.602062:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089da7c3d going to sleep for 11 seconds 00000100:00100000:1.0:1788843032.602188:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795627008 00000100:00100000:1.0:1788843032.602197:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795627008 00000100:00100000:1.0:1788843032.602401:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788843032.602410:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5b1be1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+11:5827:x1875737795627008:12345-0@lo:101: 00010000:00010000:1.0:1788843032.602423:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843032.602434:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000053c87067/0xc6b8ac1b0914a53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914a4c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.602454:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000053c87067/0xc6b8ac1b0914a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914a4c expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.602463:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000053c87067/0xc6b8ac1b0914a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914a4c expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.602471:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000053c87067, rc 0) 00000100:00100000:1.0:1788843032.602517:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5b1be1a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:5827:x1875737795627008:12345-0@lo:101: Request processed in 109us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843032.602523:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788843032.602597:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008466f0e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795627008:0@lo:101: 00010000:00010000:0.0:1788843032.602610:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000009c35eb55/0xc6b8ac1b0914a4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914a53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843032.602618:0:5827:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000009c35eb55/0xc6b8ac1b0914a4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914a53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843032.602688:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008466f0e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795627136:0@lo:501: 00000100:00100000:0.0:1788843032.602716:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843032.602895:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089da7c3d going to sleep for 11 seconds 00000100:00100000:3.0:1788843032.603204:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795627136 00000100:00100000:3.0:1788843032.603211:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795627136 00000100:00100000:3.0:1788843032.603252:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788843032.603258:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a624409 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:5827:x1875737795627136:12345-0@lo:501: 00000100:00100000:3.0:1788843032.603538:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a624409 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:5827:x1875737795627136:12345-0@lo:501: Request processed in 281us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843032.603545:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788843032.603879:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008466f0e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795627136:0@lo:501: 00000100:00100000:0.0:1788843032.603928:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008466f0e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795627264:0@lo:503: 00000100:00100000:0.0:1788843032.603975:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843032.603999:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000089da7c3d going to sleep for 11 seconds 00000100:00100000:3.0:1788843032.607874:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795627264 00000100:00100000:3.0:1788843032.607891:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795627264 00000100:00100000:3.0:1788843032.607948:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788843032.607957:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f8121da0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:5827:x1875737795627264:12345-0@lo:503: 00000100:00100000:3.0:1788843032.608462:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f8121da0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:5827:x1875737795627264:12345-0@lo:503: Request processed in 506us (4487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843032.608481:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788843032.608552:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008466f0e7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795627264:0@lo:503: 00000100:00100000:0.0:1788843032.609371:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d02754cc pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:5874:1875737795627392:0@lo:502: 00000100:00100000:0.0:1788843032.609444:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843032.609476:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set 00000000319064df going to sleep for 11 seconds 00000100:00100000:3.0:1788843032.611044:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795627392 00000100:00100000:3.0:1788843032.611059:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795627392 00000100:00100000:3.0:1788843032.611117:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788843032.611125:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ca2ddee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:5874:x1875737795627392:12345-0@lo:502: 00000100:00100000:3.0:1788843032.611541:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ca2ddee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:5874:x1875737795627392:12345-0@lo:502: Request processed in 415us (2096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843032.611550:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788843032.611811:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d02754cc pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:5874:1875737795627392:0@lo:502: 00000020:01000004:0.0:1788843032.611880:0:5874:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788843032.611894:0:5874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e0e18b13) 00000020:00000080:0.0:1788843032.611911:0:5874:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1788843032.611984:0:5874:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000946c18df from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788843032.611988:0:5874:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000946c18df from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788843032.611990:0:5874:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000946c18df 4 00010000:00080000:0.0:1788843032.612018:0:5874:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007266ba5f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:0.0:1788843032.614472:0:5874:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1788843032.614795:0:5874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1788843032.614849:0:5874:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788843032.614876:0:5874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc6b8ac1b0914a61 00000100:00080000:0.0:1788843032.614890:0:5874:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788843032.614895:0:5874:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000007266ba5f using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1788843032.614952:0:5874:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d02754cc x1875737795627520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788843032.614977:0:5874:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788843032.616517:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d02754cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875737795627520:0@lo:38: 00000100:00100000:2.0:1788843032.616604:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843032.616760:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795627520 00000100:00100000:1.0:1788843032.616770:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795627520 00000100:00100000:1.0:1788843032.616823:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843032.616830:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014fed687 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875737795627520:12345-0@lo:38: 00000100:00100000:1.0:1788843032.616914:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014fed687 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875737795627520:12345-0@lo:38: Request processed in 71us (298us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788843032.616922:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843032.617056:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788843032.617065:0:3303:0:(import.c:65:import_set_state_nolock()) 000000007266ba5f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843032.617069:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788843032.617072:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d02754cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875737795627520:0@lo:38: 00000100:00100000:1.0:1788843032.628679:0:5874:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000016863f70 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:5874:1875737795627648:0@lo:502: 00000100:00100000:1.0:1788843032.628793:0:5874:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843032.628849:0:5874:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd0d947a going to sleep for 11 seconds 00000100:00100000:2.0:1788843032.629431:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795627648 00000100:00100000:2.0:1788843032.629441:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795627648 00000100:00100000:2.0:1788843032.629506:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788843032.629516:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b6b1d7b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:5874:x1875737795627648:12345-0@lo:502: 00000100:00100000:2.0:1788843032.629779:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b6b1d7b6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:5874:x1875737795627648:12345-0@lo:502: Request processed in 264us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843032.629786:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788843032.629845:0:5874:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000016863f70 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:5874:1875737795627648:0@lo:502: 00000040:00080000:2.0:1788843032.629879:0:5874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1788843032.634512:0:5827:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1788843032.634560:0:5827:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788843032.634585:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000009c35eb55/0xc6b8ac1b0914a4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914a53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843032.634599:0:5827:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000009c35eb55/0xc6b8ac1b0914a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914a53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788843032.634672:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788843032.634674:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788843032.634676:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843032.634677:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843032.634678:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843032.634680:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843032.634682:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788843032.634683:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788843032.634685:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788843032.634686:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788843032.634687:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843032.634688:0:5827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788843032.634692:0:5827:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1788843032.634693:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788843032.634694:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788843032.634695:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843032.634696:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843032.634697:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843032.634698:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843032.634703:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788843032.634704:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788843032.634705:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788843032.634706:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788843032.634706:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843032.634707:0:5827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788843032.634736:0:5827:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788843032.634754:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b982ce5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795627776:0@lo:253: 00000100:00100000:0.0:1788843032.634840:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843032.634894:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set 0000000019aa96b6 going to sleep for 11 seconds 00000100:00100000:1.0:1788843032.635085:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795627776 00000100:00100000:1.0:1788843032.635093:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795627776 00000100:00100000:1.0:1788843032.635149:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788843032.635158:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ceb560ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:5827:x1875737795627776:12345-0@lo:253: 20000000:01000000:1.0:1788843032.635184:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788843032.635197:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788843032.716921:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788843032.716940:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788843032.717052:0:5862:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788843032.717058:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788843032.717079:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f1ee23cf/0xc6b8ac1b0914a68 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843032.717100:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000033823beb/0xc6b8ac1b0914a37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914a30 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843032.717108:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f1ee23cf/0xc6b8ac1b0914a68 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843032.717149:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000033823beb/0xc6b8ac1b0914a37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914a30 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843032.717165:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000033823beb/0xc6b8ac1b0914a37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a30 expref: 12 pid: 5840 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843032.717189:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000005e55dba pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1875737795627904:0@lo:104: 00000100:00100000:3.0:1788843032.717278:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843032.717399:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set 0000000079d58faf going to sleep for 11 seconds 00000100:00100000:1.0:1788843032.717556:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795627904 00000100:00100000:1.0:1788843032.717565:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795627904 00000100:00100000:1.0:1788843032.717627:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843032.717636:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058c58468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+3:5862:x1875737795627904:12345-0@lo:104: 00010000:00010000:1.0:1788843032.717657:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: 00000000fdfc63d1/0xc6b8ac1b0914a30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914a37 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.717714:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788843032.717719:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058c58468 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+3:5862:x1875737795627904:12345-0@lo:104: Request processed in 86us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843032.717725:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788843032.717760:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843032.717765:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 00000000fdfc63d1/0xc6b8ac1b0914a30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914a37 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.717781:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fdfc63d1 already unused, calling callback (00000000ea2bb3f4) 10000000:00010000:1.0:1788843032.717784:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 00000000fdfc63d1/0xc6b8ac1b0914a30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914a37 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.717792:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 00000000fdfc63d1/0xc6b8ac1b0914a30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914a37 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843032.717798:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 00000000fdfc63d1/0xc6b8ac1b0914a30 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914a37 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843032.717803:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788843032.717829:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 00000000fdfc63d1/0xc6b8ac1b0914a30 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914a37 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.717835:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843032.717851:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 00000000fdfc63d1/0xc6b8ac1b0914a30 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914a37 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.717856:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 00000000fdfc63d1/0xc6b8ac1b0914a30 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914a37 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.717871:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843032.717873:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843032.717874:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843032.717938:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000408957a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795628032:0@lo:103: 00000100:00100000:1.0:1788843032.717966:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843032.718026:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795628032 00000100:00100000:1.0:1788843032.718030:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795628032 00010000:00010000:1.0:1788843032.718046:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000033823beb/0xc6b8ac1b0914a37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a30 expref: 13 pid: 5840 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843032.718076:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843032.718081:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004322b19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+13:3305:x1875737795628032:12345-0@lo:103: 00010000:00010000:1.0:1788843032.718091:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843032.718094:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000033823beb/0xc6b8ac1b0914a37 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a30 expref: 13 pid: 5840 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.718103:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000033823beb/0xc6b8ac1b0914a37 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a30 expref: 13 pid: 5840 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.718118:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f1ee23cf/0xc6b8ac1b0914a68 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.718125:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f1ee23cf/0xc6b8ac1b0914a68 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788843032.718136:0:5831:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001079598s 00010000:00010000:1.0:1788843032.718140:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f1ee23cf/0xc6b8ac1b0914a68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.718146:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f1ee23cf/0xc6b8ac1b0914a68 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.718151:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f1ee23cf/0xc6b8ac1b0914a68 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.718156:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f1ee23cf/0xc6b8ac1b0914a68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.718161:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f1ee23cf already unused, calling callback (000000003fad23fd) 00010000:00010000:1.0:1788843032.718164:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f1ee23cf/0xc6b8ac1b0914a68 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.718177:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f1ee23cf/0xc6b8ac1b0914a68 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.718185:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f1ee23cf/0xc6b8ac1b0914a68 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.718195:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843032.718254:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004322b19 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+13:3305:x1875737795628032:12345-0@lo:103: Request processed in 174us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843032.718262:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843032.718295:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000408957a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795628032:0@lo:103: 00010000:00010000:1.0:1788843032.718324:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000033823beb/0xc6b8ac1b0914a37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914a30 expref: 12 pid: 5840 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843032.718335:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000005e55dba pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1875737795627904:0@lo:104: 00010000:00010000:1.0:1788843032.718386:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f1ee23cf/0xc6b8ac1b0914a68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.718395:0:5862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f1ee23cf/0xc6b8ac1b0914a68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.718400:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f1ee23cf/0xc6b8ac1b0914a68 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843032.718404:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f1ee23cf/0xc6b8ac1b0914a68 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843032.728606:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ceb560ce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+11:5827:x1875737795627776:12345-0@lo:253: Request processed in 93440us (93757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843032.728638:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788843032.728833:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b982ce5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:5827:1875737795627776:0@lo:253: 10000000:01000000:0.0:1788843032.728850:0:5827:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788843032.728853:0:5827:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788843032.728856:0:5827:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788843032.728857:0:5827:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843032.728858:0:5827:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843032.728859:0:5827:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843032.728861:0:5827:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843032.728862:0:5827:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788843032.728863:0:5827:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788843032.728864:0:5827:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788843032.728865:0:5827:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788843032.728867:0:5827:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843032.728868:0:5827:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788843032.728880:0:5827:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788843032.749252:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788843032.755177:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788843032.756756:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788843032.756957:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788843032.757161:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788843032.757944:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788843032.758981:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788843032.759176:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788843032.760621:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788843032.760876:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788843032.761817:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788843032.762089:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788843032.852518:0:5827:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788843032.954877:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1788843032.955267:0:5880:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788843032.958745:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788843032.958908:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788843032.959310:0:5827:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788843032.959317:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788843032.959476:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1788843032.960551:0:5879:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788843032.960560:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:2.0:1788843032.960578:0:5827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788843032.961206:0:5827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788843032.961488:0:5827:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788843032.962187:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788843032.962895:0:5827:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1788843032.969669:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1788843032.969831:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788843032.970394:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788843032.970560:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788843032.970690:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788843032.970843:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788843032.971032:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788843032.971182:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788843032.971337:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788843032.971501:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788843032.971644:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788843032.971785:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788843032.971934:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788843032.972059:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788843032.973417:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788843032.973995:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788843032.974637:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788843032.974771:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788843032.975024:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788843032.975191:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788843032.975381:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788843032.975983:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788843032.976199:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788843032.977014:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788843032.977302:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788843032.977779:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788843032.979102:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788843032.979335:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788843032.980010:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788843032.980191:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788843032.980409:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788843032.980858:0:5827:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788843032.981077:0:5827:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788843033.018069:0:5880:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788843033.089932:0:5827:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788843033.090184:0:5827:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9b2c18c3988 00100000:10000000:3.0:1788843033.090193:0:5827:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788843033.091532:0:5827:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788843033.091547:0:5827:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788843033.091561:0:5827:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788843033.091575:0:5827:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:2.0:1788843033.101484:0:5880:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788843033.101564:0:5880:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 1, retries 0 00000004:00080000:2.0:1788843033.101568:0:5880:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788843033.351132:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843034.372666:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843035.398374:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843036.422322:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843037.449886:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788843038.022400:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788843038.022411:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788843038.022413:0:37:0:(import.c:65:import_set_state_nolock()) 000000007266ba5f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788843038.022425:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000007266ba5f using connection 192.168.203.129@tcp/0@lo 00000100:00100000:0.0:1788843038.022447:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000a58c0c04 x1875737795628288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843038.022507:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a58c0c04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875737795628288:0@lo:38: 00000100:00100000:0.0:1788843038.022580:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843038.023030:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003b982ce5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795628160:0@lo:400: 00000100:00100000:3.0:1788843038.023084:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843038.023287:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795628160 00000100:00100000:0.0:1788843038.023296:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795628160 00000100:00100000:0.0:1788843038.023358:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788843038.023368:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014baccee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+11:3306:x1875737795628160:12345-0@lo:400: 00000100:00100000:0.0:1788843038.023415:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014baccee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+11:3306:x1875737795628160:12345-0@lo:400: Request processed in 50us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843038.023422:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788843038.023584:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003b982ce5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795628160:0@lo:400: 00000100:00100000:1.0:1788843038.023669:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795628288 00000100:00100000:1.0:1788843038.023674:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795628288 00000100:00100000:1.0:1788843038.023694:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843038.023699:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000892fab08 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875737795628288:12345-0@lo:38: 00010000:00080000:1.0:1788843038.023720:0:5848:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:1.0:1788843038.023752:0:5848:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc6b8ac1b0914a6f 00000004:00100000:1.0:1788843038.023795:0:5848:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788843038.023910:0:5848:0:(import.c:65:import_set_state_nolock()) 00000000a4d5ab25 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843038.023964:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000892fab08 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875737795628288:12345-0@lo:38: Request processed in 263us (1384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843038.023971:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788843038.024105:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000a58c0c04 x1875737795628288/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788843038.024120:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788843038.024127:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788843038.024132:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788843038.024134:0:3303:0:(import.c:65:import_set_state_nolock()) 000000007266ba5f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788843038.024150:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a58c0c04 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875737795628288:0@lo:38: 00000001:02000400:0.0:1788843038.468261:0:6123:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788843038.468627:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788843039.053168:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788843039.053177:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dab71a20000 from 3 10000000:01000000:2.0:1788843039.053182:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788843039.053245:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 000000005f8a9a44/0xc6b8ac1b0914a76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843039.053259:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 000000005f8a9a44/0xc6b8ac1b0914a76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843039.053269:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 000000005f8a9a44/0xc6b8ac1b0914a76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843039.053290:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000970b1d53 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795628416:0@lo:101: 00000100:00100000:2.0:1788843039.053398:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843039.053445:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set 0000000007b48a2f going to sleep for 11 seconds 00000100:00100000:1.0:1788843039.056019:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795628416 00000100:00100000:1.0:1788843039.056039:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795628416 00000100:00100000:1.0:1788843039.056109:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788843039.056117:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3e2578d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+11:5844:x1875737795628416:12345-0@lo:101: 00010000:00010000:1.0:1788843039.056135:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843039.056154:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000033823beb/0xc6b8ac1b0914a7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914a76 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843039.056183:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000033823beb/0xc6b8ac1b0914a7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914a76 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843039.056205:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000033823beb/0xc6b8ac1b0914a7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914a76 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843039.056216:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000033823beb, rc 0) 00000100:00100000:1.0:1788843039.056306:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3e2578d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:5844:x1875737795628416:12345-0@lo:101: Request processed in 190us (2909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843039.056312:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788843039.056412:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000970b1d53 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795628416:0@lo:101: 00010000:00010000:1.0:1788843039.056429:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 000000005f8a9a44/0xc6b8ac1b0914a76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914a7d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843039.056437:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 000000005f8a9a44/0xc6b8ac1b0914a76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914a7d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843039.057003:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000408957a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795628544:0@lo:256: 00000100:00100000:1.0:1788843039.057052:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843039.057121:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e3f88041 going to sleep for 11 seconds 00000100:00100000:0.0:1788843039.064145:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795628544 00000100:00100000:0.0:1788843039.064160:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795628544 00000100:00100000:0.0:1788843039.067210:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788843039.067240:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004996555a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:5844:x1875737795628544:12345-0@lo:256: 20000000:01000000:0.0:1788843039.067271:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788843039.067288:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788843039.067292:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1788843039.067457:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004996555a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:5844:x1875737795628544:12345-0@lo:256: Request processed in 235us (10404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843039.067483:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788843039.069305:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000408957a5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795628544:0@lo:256: 10000000:01000000:0.0:1788843039.069424:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788843039.069437:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: 000000005f8a9a44/0xc6b8ac1b0914a76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914a7d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843039.069447:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: 000000005f8a9a44/0xc6b8ac1b0914a76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914a7d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843039.492774:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843040.516690:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843041.541967:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843042.564989:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843043.148895:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eadc6ce6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795628672:0@lo:400: 00000100:00100000:0.0:1788843043.148968:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843043.149423:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795628672 00000100:00100000:1.0:1788843043.149432:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795628672 00000100:00100000:1.0:1788843043.149483:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788843043.149506:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3135563 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:3307:x1875737795628672:12345-0@lo:400: 00000100:00100000:3.0:1788843043.149718:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009095e785 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795628800:0@lo:400: 00000100:00100000:3.0:1788843043.149748:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843043.149797:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795628800 00000100:00100000:3.0:1788843043.149801:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795628800 00000100:00100000:3.0:1788843043.149828:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843043.149834:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079614681 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795628800:12345-0@lo:400: 00000100:00100000:3.0:1788843043.149882:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079614681 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795628800:12345-0@lo:400: Request processed in 48us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843043.149889:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788843043.149927:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009095e785 x1875737795628800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843059 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843043.149940:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009095e785 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795628800:0@lo:400: 00000100:00100000:1.0:1788843043.157142:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3135563 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:3307:x1875737795628672:12345-0@lo:400: Request processed in 7632us (8168us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843043.157158:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788843043.157454:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eadc6ce6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795628672:0@lo:400: 00010000:00010000:3.0:1788843043.588535:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788843043.832906:0:6325:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd54e488b0 20000000:00000080:0.0:1788843043.833120:0:6325:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dab81e1fc00 uarg=0000000000000000 20000000:01000000:0.0:1788843043.833153:0:6325:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788843043.833170:0:6325:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788843043.833175:0:6325:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788843043.833401:0:6325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1788843043.833413:0:6325:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1788843043.845466:0:6325:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788843043.845741:0:6325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788843043.845800:0:6325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1788843043.845863:0:6325:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1788843043.845881:0:6325:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788843043.845898:0:6325:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000042348505/0xc6b8ac1b0914a84 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843043.846497:0:6325:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000019a76543/0xc6b8ac1b0914a45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914a3e expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843043.846508:0:6325:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000042348505/0xc6b8ac1b0914a84 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843043.846546:0:6325:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000019a76543/0xc6b8ac1b0914a45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914a3e expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843043.846561:0:6325:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000019a76543/0xc6b8ac1b0914a45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a3e expref: 11 pid: 5840 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843043.846595:0:6325:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000055aef2d0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6325:1875737795628928:0@lo:104: 00000100:00100000:0.0:1788843043.846655:0:6325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843043.846699:0:6325:0:(client.c:2715:ptlrpc_set_wait()) set 000000007cf9426b going to sleep for 11 seconds 00000100:00100000:1.0:1788843043.846808:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795628928 00000100:00100000:1.0:1788843043.846816:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795628928 00000100:00100000:1.0:1788843043.846862:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843043.846870:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008609d385 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28cf63da-daee-485f-b466-4ec68876f732+3:6325:x1875737795628928:12345-0@lo:104: 00010000:00010000:1.0:1788843043.846880:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: 000000001fcc3402/0xc6b8ac1b0914a3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914a45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843043.846954:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788843043.846959:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008609d385 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28cf63da-daee-485f-b466-4ec68876f732+3:6325:x1875737795628928:12345-0@lo:104: Request processed in 91us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843043.846965:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788843043.846987:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843043.846992:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: 000000001fcc3402/0xc6b8ac1b0914a3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914a45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843043.846999:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001fcc3402 already unused, calling callback (00000000ea2bb3f4) 10000000:00010000:1.0:1788843043.847002:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: 000000001fcc3402/0xc6b8ac1b0914a3e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914a45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843043.847011:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: 000000001fcc3402/0xc6b8ac1b0914a3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914a45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843043.847242:0:6325:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000055aef2d0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6325:1875737795628928:0@lo:104: 00010000:00010000:2.0:1788843043.847265:0:6325:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000042348505/0xc6b8ac1b0914a84 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843043.847280:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: 000000001fcc3402/0xc6b8ac1b0914a3e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914a45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843043.847298:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788843043.847333:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: 000000001fcc3402/0xc6b8ac1b0914a3e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914a45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843043.847365:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843043.847382:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: 000000001fcc3402/0xc6b8ac1b0914a3e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914a45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843043.847389:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: 000000001fcc3402/0xc6b8ac1b0914a3e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914a45 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843043.847404:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843043.847406:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843043.847407:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843043.847419:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000aa9004d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795629056:0@lo:103: 00000100:00100000:1.0:1788843043.847451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843043.847487:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795629056 00000100:00100000:1.0:1788843043.847491:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795629056 00010000:00010000:1.0:1788843043.847507:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000019a76543/0xc6b8ac1b0914a45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a3e expref: 12 pid: 5840 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843043.847530:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843043.847536:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a16aad47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+12:3305:x1875737795629056:12345-0@lo:103: 00010000:00010000:1.0:1788843043.847548:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843043.847552:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000019a76543/0xc6b8ac1b0914a45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a3e expref: 12 pid: 5840 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843043.847563:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000019a76543/0xc6b8ac1b0914a45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a3e expref: 12 pid: 5840 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843043.847593:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000019a76543/0xc6b8ac1b0914a45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914a3e expref: 12 pid: 5840 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843043.847606:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000042348505/0xc6b8ac1b0914a84 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843043.847614:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000042348505/0xc6b8ac1b0914a84 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843043.847625:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000042348505/0xc6b8ac1b0914a84 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843043.847631:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000042348505/0xc6b8ac1b0914a84 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843043.847637:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000042348505/0xc6b8ac1b0914a84 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843043.847643:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000042348505/0xc6b8ac1b0914a84 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843043.847648:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000042348505 already unused, calling callback (000000003fad23fd) 00010000:00010000:1.0:1788843043.847651:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000042348505/0xc6b8ac1b0914a84 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843043.847657:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000042348505/0xc6b8ac1b0914a84 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843043.847667:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000042348505/0xc6b8ac1b0914a84 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843043.847685:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843043.847714:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a16aad47 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+11:3305:x1875737795629056:12345-0@lo:103: Request processed in 178us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843043.847721:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843043.847748:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000aa9004d2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795629056:0@lo:103: 00010000:00010000:2.0:1788843043.848377:0:6325:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000042348505/0xc6b8ac1b0914a84 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843043.848388:0:6325:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000042348505/0xc6b8ac1b0914a84 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843043.848409:0:6325:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000042348505/0xc6b8ac1b0914a84 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6325 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843044.612561:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843045.636794:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788843045.892587:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788843045.892595:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab71a20000 from 1 10000000:01000000:2.0:1788843045.892600:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788843045.892647:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: 00000000081bee96/0xc6b8ac1b0914a8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843045.892659:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: 00000000081bee96/0xc6b8ac1b0914a8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843045.892668:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: 00000000081bee96/0xc6b8ac1b0914a8b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843045.892691:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cde9c8a1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795629184:0@lo:101: 00000100:00100000:2.0:1788843045.892770:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843045.892853:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a109eb0f going to sleep for 11 seconds 00000100:00100000:0.0:1788843045.892993:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795629184 00000100:00100000:0.0:1788843045.893001:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795629184 00000100:00100000:0.0:1788843045.893047:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843045.893055:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000027aaeca9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+11:5844:x1875737795629184:12345-0@lo:101: 00010000:00010000:0.0:1788843045.893068:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843045.893079:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000b2abac6/0xc6b8ac1b0914a92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914a8b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843045.893099:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000b2abac6/0xc6b8ac1b0914a92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914a8b expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843045.893108:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000b2abac6/0xc6b8ac1b0914a92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914a8b expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843045.893116:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000b2abac6, rc 0) 00000100:00100000:0.0:1788843045.893166:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000027aaeca9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:5844:x1875737795629184:12345-0@lo:101: Request processed in 112us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843045.893173:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788843045.894097:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cde9c8a1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795629184:0@lo:101: 00010000:00010000:2.0:1788843045.894129:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: 00000000081bee96/0xc6b8ac1b0914a8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914a92 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843045.894138:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: 00000000081bee96/0xc6b8ac1b0914a8b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914a92 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843045.894213:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cde9c8a1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795629312:0@lo:501: 00000100:00100000:2.0:1788843045.894254:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843045.894365:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a109eb0f going to sleep for 11 seconds 00000100:00100000:1.0:1788843045.904642:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795629312 00000100:00100000:1.0:1788843045.904661:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795629312 00000100:00100000:0.0:1788843045.904933:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788843045.904943:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076c30249 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:5844:x1875737795629312:12345-0@lo:501: 00000100:00100000:0.0:1788843045.905266:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076c30249 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:5844:x1875737795629312:12345-0@lo:501: Request processed in 324us (11011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843045.905274:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788843045.905486:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cde9c8a1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795629312:0@lo:501: 00000100:00100000:2.0:1788843045.905537:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cde9c8a1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795629440:0@lo:503: 00000100:00100000:2.0:1788843045.905594:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843045.905940:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795629440 00000100:00100000:0.0:1788843045.905946:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795629440 00000100:00100000:0.0:1788843045.905984:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788843045.905991:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044140003 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:5844:x1875737795629440:12345-0@lo:503: 00000100:00100000:0.0:1788843045.906111:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044140003 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:5844:x1875737795629440:12345-0@lo:503: Request processed in 121us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843045.906118:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788843045.906823:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a109eb0f going to sleep for 11 seconds 00000100:00100000:2.0:1788843045.906844:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cde9c8a1 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795629440:0@lo:503: 00000100:00100000:3.0:1788843045.910078:0:6386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009095e785 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:6386:1875737795629568:0@lo:502: 00000100:00100000:3.0:1788843045.910179:0:6386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843045.910230:0:6386:0:(client.c:2715:ptlrpc_set_wait()) set 000000007c8be07d going to sleep for 11 seconds 00000100:00100000:0.0:1788843045.910701:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795629568 00000100:00100000:0.0:1788843045.910722:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795629568 00000100:00100000:0.0:1788843045.910767:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788843045.910775:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f89a61c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:6386:x1875737795629568:12345-0@lo:502: 00000100:00100000:0.0:1788843045.910978:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f89a61c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:6386:x1875737795629568:12345-0@lo:502: Request processed in 203us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843045.910985:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843045.911447:0:6386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009095e785 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:6386:1875737795629568:0@lo:502: 00000020:01000000:1.0:1788843045.911484:0:6386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843045.911493:0:6386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843045.911495:0:6386:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788843045.911502:0:6386:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dab71a20000 00000020:00000080:1.0:1788843045.911505:0:6386:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788843045.911568:0:6386:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:6386:1875737795629696:0@lo:502: 00000100:00100000:1.0:1788843045.911612:0:6386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843045.911644:0:6386:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51b15e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843045.911819:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795629696 00000100:00100000:2.0:1788843045.911825:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795629696 00000100:00100000:2.0:1788843045.911851:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788843045.911858:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:6386:x1875737795629696:12345-0@lo:502: 00000100:00100000:2.0:1788843045.912013:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:6386:x1875737795629696:12345-0@lo:502: Request processed in 155us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843045.912020:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843045.913644:0:6386:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:6386:1875737795629696:0@lo:502: 00000020:01000000:1.0:1788843045.913684:0:6386:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843045.913694:0:6386:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843045.913696:0:6386:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788843045.913701:0:6386:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788843045.914654:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788843045.914680:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843045.914692:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0914a8b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914a92 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843045.914703:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0914a8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914a92 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843046.664816:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843047.686327:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843048.261321:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795629952:0@lo:400: 00000100:00100000:0.0:1788843048.261423:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843048.261504:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843048.261510:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795629824:0@lo:400: 00000100:00100000:0.0:1788843048.261550:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843048.261636:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795629824 00000100:00100000:2.0:1788843048.261645:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795629824 00000100:00100000:2.0:1788843048.261714:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788843048.261726:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:3307:x1875737795629824:12345-0@lo:400: 00000100:00100000:2.0:1788843048.261799:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:3307:x1875737795629824:12345-0@lo:400: Request processed in 75us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843048.261807:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788843048.262164:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795629824:0@lo:400: 00000100:00100000:1.0:1788843048.262338:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795629952 00000100:00100000:1.0:1788843048.262361:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795629952 00000100:00100000:1.0:1788843048.262401:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843048.262408:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795629952:12345-0@lo:400: 00000100:00100000:1.0:1788843048.262474:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795629952:12345-0@lo:400: Request processed in 66us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843048.262481:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788843048.262634:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dab6ec4aa00 x1875737795629952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843048.262647:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795629952:0@lo:400: 00010000:00010000:0.0:1788843048.708488:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843049.733026:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843050.757765:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788843050.967816:0:6690:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788843050.967821:0:6690:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788843050.968018:0:6690:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dab7395d800 00000020:01000004:1.0:1788843050.968039:0:6690:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788843050.968055:0:6690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788843050.968073:0:6690:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8dab60074d28) 00000020:00000080:1.0:1788843050.968091:0:6690:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788843050.983903:0:6690:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788843050.984208:0:6690:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788843051.003404:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788843051.008238:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788843051.008841:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788843051.009330:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788843051.009428:0:6690:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788843051.009911:0:6690:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788843051.009926:0:6690:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788843051.009940:0:6690:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc6b8ac1b0914aa0 00000020:01000004:0.0:1788843051.009951:0:6690:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788843051.009981:0:6690:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788843051.009985:0:6690:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788843051.009992:0:6690:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788843051.009998:0:6690:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788843051.010012:0:6690:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8dab440eb370) 00000020:00000080:0.0:1788843051.010024:0:6690:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1788843051.012567:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788843051.012851:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788843051.012858:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788843051.014839:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788843051.014854:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788843051.016428:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788843051.016442:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788843051.027273:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843051.028852:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788843051.028861:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1788843051.032671:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1788843051.032693:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788843051.059702:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788843051.060057:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788843051.060065:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788843051.062706:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788843051.062725:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788843051.064821:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788843051.064842:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788843051.067328:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788843051.067849:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788843051.067864:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788843051.068628:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788843051.068636:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788843051.096245:0:6690:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788843051.096608:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788843051.096616:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788843051.098725:0:6690:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788843051.098749:0:6690:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788843051.099240:0:6690:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788843051.099430:0:6690:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788843051.099440:0:6690:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788843051.121620:0:6690:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788843051.121673:0:6690:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.129@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788843051.121679:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788843051.121682:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788843051.121684:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843051.121686:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843051.121688:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843051.121689:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843051.121691:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788843051.121693:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788843051.121695:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788843051.121697:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843051.121699:0:6690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788843051.121704:0:6690:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788843051.121707:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788843051.121709:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788843051.121710:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843051.121711:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843051.121713:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843051.121714:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843051.121715:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788843051.121716:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788843051.121718:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788843051.121719:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843051.121721:0:6690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788843051.121764:0:6690:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788843051.121787:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795630080:0@lo:253: 00000100:00100000:0.0:1788843051.121998:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843051.122062:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51b15480 going to sleep for 11 seconds 00000100:00100000:3.0:1788843051.123815:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795630080 00000100:00100000:3.0:1788843051.123830:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795630080 00000100:00100000:3.0:1788843051.123910:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788843051.123923:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795630080:12345-0@lo:253: 20000000:01000000:3.0:1788843051.123970:0:5839:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788843051.123975:0:5839:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788843051.123981:0:5839:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788843051.123984:0:5839:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788843051.125957:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843051.126888:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788843051.126904:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788843051.126944:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1788843051.126952:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788843051.130241:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788843051.130857:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788843051.133482:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788843051.133518:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.129@tcp 20000000:01000000:2.0:1788843051.133521:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:2.0:1788843051.133588:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788843051.133598:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788843051.133651:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788843051.133659:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:2.0:1788843051.133690:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788843051.133699:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788843051.133727:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788843051.133780:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788843051.134539:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788843051.134556:0:5839:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.129@tcp 20000000:01000000:2.0:1788843051.134558:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:2.0:1788843051.134592:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788843051.134600:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788843051.134654:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788843051.134667:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:2.0:1788843051.134714:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788843051.134722:0:5839:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788843051.134753:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788843051.134791:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788843051.134807:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788843051.134810:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788843051.134816:0:5839:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788843051.134817:0:5839:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788843051.134820:0:5839:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788843051.134832:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788843051.134835:0:5839:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788843051.134868:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788843051.134870:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788843051.137832:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788843051.137918:0:6705:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1788843051.137976:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788843051.139809:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788843051.139855:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788843051.139928:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788843051.139942:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788843051.139945:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788843051.142334:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788843051.142438:0:6706:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788843051.142491:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788843051.143745:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788843051.143810:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788843051.143847:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788843051.143863:0:5839:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788843051.143866:0:5839:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788843051.144989:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788843051.145224:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788843051.145262:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788843051.145329:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:0.0:1788843051.145389:0:5839:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788843051.145408:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914aae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.145422:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b09149c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b09149c0 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.145428:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab41533200/0xc6b8ac1b09149e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b09149dc expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.145432:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab82054200/0xc6b8ac1b0914a53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914a4c expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.145437:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914aae lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.145468:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab82054200/0xc6b8ac1b0914a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914a4c expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.145479:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab82054200/0xc6b8ac1b0914a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a4c expref: 12 pid: 5840 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843051.145503:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd43800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1875737795630208:0@lo:104: 00000100:00100000:0.0:1788843051.145855:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843051.145906:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795630208 00000100:00100000:1.0:1788843051.145913:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795630208 00010000:00010000:0.0:1788843051.145915:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab41533200/0xc6b8ac1b09149e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b09149dc expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.145923:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab41533200/0xc6b8ac1b09149e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b09149dc expref: 12 pid: 5839 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843051.145931:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1875737795630336:0@lo:104: 00000100:00100000:0.0:1788843051.145953:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843051.145958:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795630336 00000100:00100000:1.0:1788843051.145961:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795630336 00010000:00010000:0.0:1788843051.145970:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b09149c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b09149c0 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843051.145976:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788843051.145978:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b09149c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b09149c0 expref: 12 pid: 5839 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843051.145984:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+4:5839:x1875737795630208:12345-0@lo:104: 00000100:00100000:0.0:1788843051.145986:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd43b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1875737795630464:0@lo:104: 00010000:00010000:1.0:1788843051.145996:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914a53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843051.146003:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843051.146012:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51b15540 going to sleep for 11 seconds 00010000:00010000:1.0:1788843051.146049:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788843051.146055:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+4:5839:x1875737795630208:12345-0@lo:104: Request processed in 72us (201us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843051.146063:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843051.146066:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795630464 00000100:00100000:3.0:1788843051.146069:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795630464 00000100:00100000:1.0:1788843051.146079:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843051.146084:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+4:5839:x1875737795630336:12345-0@lo:104: 00010000:00010000:2.0:1788843051.146106:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843051.146123:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914a53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.146130:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40031c00 already unused, calling callback (ffffffffc1a4ec20) 00000100:00100000:0.0:1788843051.146131:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd43800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1875737795630208:0@lo:104: 10000000:00010000:2.0:1788843051.146134:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914a4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914a53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.146143:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914a53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843051.146150:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914a4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914a53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843051.146164:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788843051.146198:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914a4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914a53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.146205:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843051.146232:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914a4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914a53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843051.146286:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843051.146297:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795630592:0@lo:103: 00010000:00010000:1.0:1788843051.146321:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab82054e00/0xc6b8ac1b09149dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b09149e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843051.146325:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843051.146411:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788843051.146417:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+4:5839:x1875737795630336:12345-0@lo:104: Request processed in 333us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843051.146424:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843051.146439:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843051.146445:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+3:5839:x1875737795630464:12345-0@lo:104: 00010000:00010000:1.0:1788843051.146453:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab82054a00/0xc6b8ac1b09149c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b09149c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843051.146458:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1875737795630336:0@lo:104: 00010000:00010000:1.0:1788843051.146484:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788843051.146489:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+3:5839:x1875737795630464:12345-0@lo:104: Request processed in 45us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843051.146494:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd43b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5839:1875737795630464:0@lo:104: 00000100:00100000:1.0:1788843051.146496:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788843051.146514:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914aae lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.146546:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914a4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914a53 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.146560:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843051.146564:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab82054e00/0xc6b8ac1b09149dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b09149e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.146569:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054e00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:2.0:1788843051.146572:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab82054e00/0xc6b8ac1b09149dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b09149e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.146578:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab82054e00/0xc6b8ac1b09149dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b09149e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843051.146584:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab82054e00/0xc6b8ac1b09149dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b09149e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843051.146589:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788843051.146615:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab82054e00/0xc6b8ac1b09149dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b09149e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.146622:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843051.146638:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab82054e00/0xc6b8ac1b09149dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b09149e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.146645:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab82054e00/0xc6b8ac1b09149dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b09149e3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.146656:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843051.146660:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab82054a00/0xc6b8ac1b09149c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b09149c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.146667:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054a00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:2.0:1788843051.146669:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab82054a00/0xc6b8ac1b09149c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b09149c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.146676:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab82054a00/0xc6b8ac1b09149c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b09149c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843051.146682:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab82054a00/0xc6b8ac1b09149c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b09149c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843051.146688:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788843051.146705:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab82054a00/0xc6b8ac1b09149c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b09149c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.146711:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788843051.146717:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1788843051.146724:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab82054a00/0xc6b8ac1b09149c0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b09149c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843051.146726:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795630720:0@lo:103: 00010000:00010000:2.0:1788843051.146731:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab82054a00/0xc6b8ac1b09149c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b09149c7 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.146743:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843051.146751:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843051.146753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788843051.146753:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843051.146760:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843051.146769:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795630848:0@lo:103: 00000100:00100000:2.0:1788843051.146795:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843051.146844:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795630592 00000100:00100000:3.0:1788843051.146849:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795630592 00010000:00010000:3.0:1788843051.146867:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab82054200/0xc6b8ac1b0914a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a4c expref: 13 pid: 5840 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843051.146867:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795630720 00000100:00100000:1.0:1788843051.146870:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795630720 00000100:00100000:3.0:1788843051.146880:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795630848 00010000:00010000:1.0:1788843051.146881:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab41533200/0xc6b8ac1b09149e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b09149dc expref: 14 pid: 5839 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843051.146882:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795630848 00010000:00010000:3.0:1788843051.146891:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b09149c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b09149c0 expref: 15 pid: 5839 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843051.146894:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788843051.146899:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+15:3305:x1875737795630592:12345-0@lo:103: 00000100:00100000:3.0:1788843051.146901:0:5833:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788843051.146909:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788843051.146912:0:5833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1788843051.146913:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab82054200/0xc6b8ac1b0914a53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a4c expref: 15 pid: 5840 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.146924:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab82054200/0xc6b8ac1b0914a53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a4c expref: 15 pid: 5840 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.146937:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab82054200/0xc6b8ac1b0914a53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914a4c expref: 15 pid: 5840 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.146956:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843051.146988:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+14:3305:x1875737795630592:12345-0@lo:103: Request processed in 88us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843051.146994:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843051.147004:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795630592:0@lo:103: 00000100:00100000:1.0:1788843051.147007:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843051.147012:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+13:3304:x1875737795630720:12345-0@lo:103: 00010000:00010000:1.0:1788843051.147020:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843051.147025:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab41533200/0xc6b8ac1b09149e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b09149dc expref: 13 pid: 5839 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.147034:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab41533200/0xc6b8ac1b09149e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b09149dc expref: 13 pid: 5839 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.147044:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab41533200/0xc6b8ac1b09149e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b09149dc expref: 13 pid: 5839 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.147053:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843051.147084:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+12:3304:x1875737795630720:12345-0@lo:103: Request processed in 71us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843051.147090:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843051.147101:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec48e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795630720:0@lo:103: 00000100:00100000:1.0:1788843051.147101:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843051.147107:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+11:3307:x1875737795630848:12345-0@lo:103: 00010000:00010000:1.0:1788843051.147125:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843051.147130:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b09149c7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b09149c0 expref: 11 pid: 5839 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.147139:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b09149c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b09149c0 expref: 11 pid: 5839 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.147156:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b09149c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b09149c0 expref: 11 pid: 5839 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.147169:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914aae lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.147176:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914aae lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.147188:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914aae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.147194:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914aae lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.147201:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914aae lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.147207:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914aae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.147212:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40031a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843051.147217:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914aae lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.147224:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914aae lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.147685:0:5839:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914aae lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.147686:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914aae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.147695:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914aae lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788843051.147705:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:1.0:1788843051.147706:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914aae lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.147720:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843051.147763:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec4b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+10:3307:x1875737795630848:12345-0@lo:103: Request processed in 656us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843051.147771:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788843051.147791:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843051.147806:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795630848:0@lo:103: 00000100:00100000:2.0:1788843051.207470:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+9:6690:x1875737795630080:12345-0@lo:253: Request processed in 83542us (85463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843051.207485:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788843051.207759:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795630080:0@lo:253: 10000000:01000000:0.0:1788843051.207775:0:6690:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788843051.207778:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788843051.207780:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788843051.207782:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843051.207783:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1788843051.207785:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843051.207786:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843051.207788:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788843051.207789:0:6690:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788843051.207791:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843051.207792:0:6690:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788843051.207811:0:6690:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dab7395d800 from lustre-OST0000 10000000:01000000:0.0:1788843051.207835:0:6690:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788843051.207838:0:6690:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788843051.207845:0:6690:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dab600719b8 local copy 10000000:01000000:0.0:1788843051.207849:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788843051.207882:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab40031800/0xc6b8ac1b0914ab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.207894:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.129@tcp lock: ffff8dab40031800/0xc6b8ac1b0914ab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.207916:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab40031800/0xc6b8ac1b0914ab5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843051.207933:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795630976:0@lo:101: 00000100:00100000:0.0:1788843051.207970:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843051.208026:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51b15a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843051.208122:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795630976 00000100:00100000:2.0:1788843051.208128:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795630976 00000100:00100000:2.0:1788843051.208175:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788843051.208184:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+9:6690:x1875737795630976:12345-0@lo:101: 00010000:00010000:2.0:1788843051.208310:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843051.208326:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914abc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914ab5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.208387:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914ab5 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.208398:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914abc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914ab5 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.208406:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4000, rc 0) 00000100:00100000:2.0:1788843051.208441:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+10:6690:x1875737795630976:12345-0@lo:101: Request processed in 258us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843051.208447:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788843051.208531:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795630976:0@lo:101: 00010000:00010000:0.0:1788843051.208710:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab40031800/0xc6b8ac1b0914ab5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc6b8ac1b0914abc expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.208721:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab40031800/0xc6b8ac1b0914ab5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc6b8ac1b0914abc expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843051.208819:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795631104:0@lo:501: 00000100:00100000:0.0:1788843051.208861:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843051.208888:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51b15a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843051.208946:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795631104 00000100:00100000:2.0:1788843051.208950:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795631104 00000100:00100000:2.0:1788843051.208981:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788843051.208988:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+10:6690:x1875737795631104:12345-0@lo:501: 00000100:00100000:2.0:1788843051.209315:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+10:6690:x1875737795631104:12345-0@lo:501: Request processed in 327us (452us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843051.209322:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788843051.209502:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795631104:0@lo:501: 10000000:01000000:1.0:1788843051.209685:0:6690:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788843051.209716:0:6690:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788843051.209723:0:6690:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab40031800/0xc6b8ac1b0914ab5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc6b8ac1b0914abc expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.209732:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab40031800/0xc6b8ac1b0914ab5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc6b8ac1b0914abc expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.209739:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab40031800/0xc6b8ac1b0914ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc6b8ac1b0914abc expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.209789:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788843051.209806:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dab7395d800 10000000:01000000:1.0:1788843051.209810:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788843051.209815:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8dab600719b8 10000000:01000000:1.0:1788843051.209817:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788843051.209821:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8dab600719b8 from 1 10000000:01000000:1.0:1788843051.209823:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788843051.209842:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a800/0xc6b8ac1b0914ac3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.209855:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab4933a800/0xc6b8ac1b0914ac3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.209863:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab4933a800/0xc6b8ac1b0914ac3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843051.209874:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795631232:0@lo:101: 00000100:00100000:1.0:1788843051.209903:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843051.209931:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843051.209979:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795631232 00000100:00100000:0.0:1788843051.209984:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795631232 00000100:00100000:0.0:1788843051.210015:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788843051.210021:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+10:6690:x1875737795631232:12345-0@lo:101: 00010000:00010000:0.0:1788843051.210029:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843051.210040:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab40031e00/0xc6b8ac1b0914aca lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914ac3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.210055:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab40031e00/0xc6b8ac1b0914aca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914ac3 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.210064:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab40031e00/0xc6b8ac1b0914aca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914ac3 expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.210095:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab40031e00, rc 0) 00000100:00100000:0.0:1788843051.210152:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+11:6690:x1875737795631232:12345-0@lo:101: Request processed in 131us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843051.210158:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788843051.210336:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795631232:0@lo:101: 00010000:00010000:1.0:1788843051.210374:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab4933a800/0xc6b8ac1b0914ac3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914aca expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.210382:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab4933a800/0xc6b8ac1b0914ac3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914aca expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843051.210397:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788843051.210404:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a800/0xc6b8ac1b0914ac3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914aca expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.210411:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933a800/0xc6b8ac1b0914ac3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914aca expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843051.210417:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788843051.210421:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788843051.210425:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788843051.210427:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788843051.210440:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933b400/0xc6b8ac1b0914ad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.210452:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab4933b400/0xc6b8ac1b0914ad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.210459:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab4933b400/0xc6b8ac1b0914ad1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843051.210471:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795631360:0@lo:101: 00000100:00100000:1.0:1788843051.210493:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843051.210518:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843051.210623:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795631360 00000100:00100000:3.0:1788843051.210627:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795631360 00000100:00100000:3.0:1788843051.210648:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788843051.210654:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+11:6690:x1875737795631360:12345-0@lo:101: 00010000:00010000:3.0:1788843051.210660:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843051.210667:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab41533e00/0xc6b8ac1b0914ad8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914ad1 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.210680:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41533e00/0xc6b8ac1b0914ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914ad1 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.210688:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab41533e00/0xc6b8ac1b0914ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914ad1 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.210694:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41533e00, rc 0) 00000100:00100000:3.0:1788843051.210726:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795631360:12345-0@lo:101: Request processed in 72us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843051.210731:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788843051.210882:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795631360:0@lo:101: 00010000:00010000:1.0:1788843051.210893:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab4933b400/0xc6b8ac1b0914ad1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914ad8 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.210901:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab4933b400/0xc6b8ac1b0914ad1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914ad8 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843051.210980:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795631488:0@lo:501: 00000100:00100000:1.0:1788843051.211004:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843051.211024:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843051.211086:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795631488 00000100:00100000:0.0:1788843051.211090:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795631488 00000100:00100000:0.0:1788843051.211128:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788843051.211134:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795631488:12345-0@lo:501: 00000100:00100000:0.0:1788843051.211409:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795631488:12345-0@lo:501: Request processed in 274us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843051.211415:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788843051.211553:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795631488:0@lo:501: 00000100:00100000:1.0:1788843051.211583:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795631616:0@lo:503: 00000100:00100000:1.0:1788843051.211621:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843051.211648:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843051.211754:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795631616 00000100:00100000:0.0:1788843051.211758:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795631616 00000100:00100000:0.0:1788843051.211788:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788843051.211795:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795631616:12345-0@lo:503: 00000100:00100000:0.0:1788843051.211929:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795631616:12345-0@lo:503: Request processed in 134us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843051.211935:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788843051.212143:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795631616:0@lo:503: 00000040:00080000:1.0:1788843051.212490:0:6690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788843051.212664:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795631744:0@lo:502: 00000100:00100000:1.0:1788843051.212700:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843051.212805:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafdc00 going to sleep for 11 seconds 00010000:00010000:2.0:1788843051.212914:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843051.212923:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab40031800/0xc6b8ac1b0914ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc6b8ac1b0914abc expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.212933:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40031800 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:2.0:1788843051.212937:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab40031800/0xc6b8ac1b0914ab5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc6b8ac1b0914abc expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.212948:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab40031800/0xc6b8ac1b0914ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc6b8ac1b0914abc expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843051.212955:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab40031800/0xc6b8ac1b0914ab5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc6b8ac1b0914abc expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843051.212961:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788843051.212982:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab40031800/0xc6b8ac1b0914ab5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6b8ac1b0914abc expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.212988:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788843051.213041:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788843051.213060:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab40031800/0xc6b8ac1b0914ab5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6b8ac1b0914abc expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.213068:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab40031800/0xc6b8ac1b0914ab5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6b8ac1b0914abc expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.213082:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843051.213084:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843051.213094:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843051.213171:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795631744 00000100:00100000:3.0:1788843051.213177:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795631744 00000100:00100000:3.0:1788843051.213280:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788843051.213289:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795631744:12345-0@lo:502: 00000100:00100000:3.0:1788843051.213462:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795631744:12345-0@lo:502: Request processed in 174us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843051.213469:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788843051.213767:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795631744:0@lo:502: 00000040:00080000:2.0:1788843051.213984:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788843051.214034:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788843051.214069:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788843051.214134:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788843051.214172:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788843051.214281:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788843051.214305:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795632000:0@lo:502: 00000100:00100000:2.0:1788843051.214378:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843051.214402:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab49368600 going to sleep for 11 seconds 00000100:00100000:3.0:1788843051.214506:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795632000 00000100:00100000:3.0:1788843051.214512:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795632000 00000100:00100000:3.0:1788843051.214749:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788843051.214756:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795632000:12345-0@lo:502: 00000100:00100000:3.0:1788843051.214991:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795632000:12345-0@lo:502: Request processed in 234us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843051.214997:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788843051.215089:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795631872:0@lo:103: 00000100:00100000:1.0:1788843051.215129:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843051.215418:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795631872 00000100:00100000:2.0:1788843051.215423:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795631872 00000100:00100000:2.0:1788843051.215454:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843051.215462:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+12:3306:x1875737795631872:12345-0@lo:103: 00010000:00010000:2.0:1788843051.215473:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843051.215491:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914abc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0914ab5 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.215506:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843051.215669:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+11:3306:x1875737795631872:12345-0@lo:103: Request processed in 207us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843051.215676:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843051.215749:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795631872:0@lo:103: 00000100:00100000:0.0:1788843051.215923:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795632000:0@lo:502: 00000040:00080000:0.0:1788843051.216055:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788843051.216070:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1788843051.216926:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788843051.216934:0:6709:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1788843051.216940:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843051.216942:0:6709:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788843051.216947:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788843051.216961:0:6709:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8dab477db370) 00000020:00000080:3.0:1788843051.216981:0:6709:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788843051.216986:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788843051.217052:0:6709:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dab7395d800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788843051.217059:0:6709:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788843051.217067:0:6709:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc6b8ac1b0914ae6 00010000:00010000:3.0:1788843051.224077:0:6709:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788843051.224818:0:6709:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788843051.228400:0:6709:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788843051.229001:0:6709:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788843051.237189:0:6709:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788843051.241260:0:6709:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788843051.244274:0:6709:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788843051.244287:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843051.244293:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843051.244295:0:6709:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788843051.244299:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843051.244302:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843051.244304:0:6709:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788843051.244314:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788843051.244316:0:6709:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788843051.244410:0:6709:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843051.244414:0:6709:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843051.244416:0:6709:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788843051.244419:0:6709:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788843051.244746:0:6690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788843051.244774:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788843051.244790:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933b400/0xc6b8ac1b0914ad1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914ad8 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.244815:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933b400/0xc6b8ac1b0914ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914ad8 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843051.244824:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab7395d800 from 1 10000000:01000000:0.0:1788843051.244827:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843051.244859:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab40030000/0xc6b8ac1b0914aed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.244867:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab40030000/0xc6b8ac1b0914aed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.244878:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab40030000/0xc6b8ac1b0914aed lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843051.244900:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795632128:0@lo:101: 00000100:00100000:0.0:1788843051.244965:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843051.245005:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795632128 00000100:00100000:0.0:1788843051.245012:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795632128 00000100:00100000:0.0:1788843051.245059:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788843051.245068:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+11:6690:x1875737795632128:12345-0@lo:101: 00010000:00010000:0.0:1788843051.245080:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843051.245092:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab40031800/0xc6b8ac1b0914af4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914aed expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.245129:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab40031800/0xc6b8ac1b0914af4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914aed expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.245140:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab40031800/0xc6b8ac1b0914af4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914aed expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.245156:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab40031800, rc 0) 00000100:00100000:0.0:1788843051.245190:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795632128:12345-0@lo:101: Request processed in 123us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843051.245209:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788843051.245263:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51b15c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843051.245284:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795632128:0@lo:101: 00010000:00010000:0.0:1788843051.245298:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab40030000/0xc6b8ac1b0914aed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914af4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.245306:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab40030000/0xc6b8ac1b0914aed lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914af4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843051.245412:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795632256:0@lo:501: 00000100:00100000:0.0:1788843051.245436:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843051.245448:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51b15c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843051.245772:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795632256 00000100:00100000:3.0:1788843051.245778:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795632256 00000100:00100000:3.0:1788843051.245810:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788843051.245818:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795632256:12345-0@lo:501: 00000100:00100000:3.0:1788843051.246054:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795632256:12345-0@lo:501: Request processed in 236us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843051.246061:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788843051.246151:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd43b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795632256:0@lo:501: 00000100:00100000:1.0:1788843051.246184:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795632384:0@lo:503: 00000100:00100000:1.0:1788843051.246237:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843051.246267:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafdc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843051.246393:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795632384 00000100:00100000:3.0:1788843051.246398:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795632384 00000100:00100000:3.0:1788843051.246420:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788843051.246426:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795632384:12345-0@lo:503: 00000100:00100000:3.0:1788843051.246821:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795632384:12345-0@lo:503: Request processed in 394us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843051.246827:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788843051.246904:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795632384:0@lo:503: 00000040:00080000:1.0:1788843051.247285:0:6690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788843051.247399:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795632512:0@lo:502: 00000100:00100000:1.0:1788843051.247444:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843051.247478:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843051.247589:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795632512 00000100:00100000:0.0:1788843051.247595:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795632512 00000100:00100000:0.0:1788843051.247627:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788843051.247635:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795632512:12345-0@lo:502: 00000100:00100000:0.0:1788843051.247799:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795632512:12345-0@lo:502: Request processed in 164us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843051.247806:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788843051.248031:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795632512:0@lo:502: 00000040:00080000:1.0:1788843051.248708:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788843051.248774:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788843051.248805:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795632640:0@lo:502: 00000100:00100000:1.0:1788843051.248858:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843051.248894:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843051.249298:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795632640 00000100:00100000:0.0:1788843051.249307:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795632640 00000100:00100000:0.0:1788843051.249369:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788843051.249377:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795632640:12345-0@lo:502: 00000100:00100000:0.0:1788843051.250270:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795632640:12345-0@lo:502: Request processed in 815us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843051.250281:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788843051.250695:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795632640:0@lo:502: 00000040:00080000:1.0:1788843051.250848:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788843051.250864:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788843051.254129:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843051.254147:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843051.254157:0:6712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788843051.254166:0:6712:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dab7395d800 00000020:00000080:1.0:1788843051.254168:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788843051.254207:0:6712:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843051.254211:0:6712:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843051.254213:0:6712:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788843051.254216:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788843051.254493:0:6690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788843051.254530:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788843051.254558:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab40030000/0xc6b8ac1b0914aed lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914af4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.254573:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab40030000/0xc6b8ac1b0914aed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914af4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843051.254617:0:6690:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788843051.254621:0:6690:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dab7395d800 10000000:01000000:0.0:1788843051.254624:0:6690:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dab7395d800 10000000:01000000:0.0:1788843051.254628:0:6690:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788843051.254635:0:6690:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dab7395d800 from 1 10000000:01000000:0.0:1788843051.254637:0:6690:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788843051.254679:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914afb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.254688:0:6690:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914afb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.254699:0:6690:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914afb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843051.254724:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795632768:0@lo:101: 00000100:00100000:0.0:1788843051.254790:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843051.254835:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51b15a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788843051.255179:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795632768 00000100:00100000:0.0:1788843051.255260:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795632768 00000100:00100000:0.0:1788843051.255315:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788843051.255324:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795632768:12345-0@lo:101: 00010000:00010000:0.0:1788843051.255337:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843051.255376:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914b02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914afb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.255399:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914afb expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.255410:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914afb expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843051.255419:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab40031a00, rc 0) 00000100:00100000:0.0:1788843051.255465:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+13:6690:x1875737795632768:12345-0@lo:101: Request processed in 142us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843051.255472:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788843051.255585:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795632768:0@lo:101: 00010000:00010000:2.0:1788843051.255600:0:6690:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914afb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914b02 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843051.255609:0:6690:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914afb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914b02 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843051.255712:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec48000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795632896:0@lo:501: 00000100:00100000:2.0:1788843051.255741:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843051.255765:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab54088240 going to sleep for 11 seconds 00000100:00100000:1.0:1788843051.255936:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795632896 00000100:00100000:1.0:1788843051.255941:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795632896 00000100:00100000:1.0:1788843051.255976:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788843051.255985:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+13:6690:x1875737795632896:12345-0@lo:501: 00000100:00100000:1.0:1788843051.256369:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+13:6690:x1875737795632896:12345-0@lo:501: Request processed in 384us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843051.256376:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788843051.256414:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec48000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795632896:0@lo:501: 00000100:00100000:1.0:1788843051.256446:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795633024:0@lo:503: 00000100:00100000:1.0:1788843051.256485:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843051.256500:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843051.256513:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795633024 00000100:00100000:1.0:1788843051.256516:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795633024 00000100:00100000:1.0:1788843051.256655:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788843051.256662:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+13:6690:x1875737795633024:12345-0@lo:503: 00000100:00100000:1.0:1788843051.256804:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+13:6690:x1875737795633024:12345-0@lo:503: Request processed in 141us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843051.256811:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788843051.256849:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795633024:0@lo:503: 00000040:00080000:1.0:1788843051.257125:0:6690:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788843051.257184:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795633152:0@lo:502: 00000100:00100000:1.0:1788843051.257494:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843051.257638:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab71b0f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788843051.257921:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795633152 00000100:00100000:0.0:1788843051.257928:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795633152 00000100:00100000:0.0:1788843051.258001:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788843051.258011:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+13:6690:x1875737795633152:12345-0@lo:502: 00000100:00100000:0.0:1788843051.258758:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+13:6690:x1875737795633152:12345-0@lo:502: Request processed in 747us (1261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843051.258767:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788843051.260953:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795633152:0@lo:502: 00000040:00080000:2.0:1788843051.261415:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788843051.261479:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788843051.261514:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788843051.261713:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788843051.261738:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788843051.261764:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788843051.261781:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788843051.261797:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788843051.261838:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788843051.261881:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788843051.261930:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788843051.261979:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788843051.262011:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788843051.262039:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788843051.262075:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788843051.262101:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788843051.262329:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788843051.262439:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788843051.262467:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788843051.262491:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788843051.262670:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788843051.262711:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788843051.262743:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788843051.262785:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788843051.262816:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788843051.262856:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788843051.262906:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788843051.262933:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788843051.262981:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795633280:0@lo:502: 00000100:00100000:2.0:1788843051.263054:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843051.263116:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab54088240 going to sleep for 11 seconds 00000100:00100000:0.0:1788843051.263267:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795633280 00000100:00100000:0.0:1788843051.263275:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795633280 00000100:00100000:0.0:1788843051.263378:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788843051.263389:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+13:6690:x1875737795633280:12345-0@lo:502: 00000100:00100000:0.0:1788843051.263615:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+13:6690:x1875737795633280:12345-0@lo:502: Request processed in 227us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843051.263630:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788843051.263651:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795633280:0@lo:502: 00000040:00080000:2.0:1788843051.263730:0:6690:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788843051.263741:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788843051.264511:0:6714:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788843051.264630:0:6714:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8dab7ffdcd28) 00000020:00000080:2.0:1788843051.264651:0:6714:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788843051.264722:0:6714:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dab7395d800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788843051.264725:0:6714:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dab7395d800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788843051.264727:0:6714:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab7395d800 3 00010000:00080000:2.0:1788843051.264749:0:6714:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dab7d99d000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1788843051.267478:0:6714:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788843051.267801:0:6714:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788843051.267840:0:6714:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788843051.267854:0:6714:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc6b8ac1b0914b10 00000100:00080000:2.0:1788843051.267865:0:6714:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788843051.267870:0:6714:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dab7d99d000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1788843051.267908:0:6714:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab6ec4bb80 x1875737795633408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843051.267980:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875737795633408:0@lo:38: 00000100:00100000:0.0:1788843051.268055:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788843051.268129:0:6714:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788843051.268333:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795633408 00000100:00100000:0.0:1788843051.268418:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795633408 00000100:00100000:0.0:1788843051.268451:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843051.268458:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875737795633408:12345-0@lo:38: 00010000:00080000:0.0:1788843051.268480:0:5848:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:0.0:1788843051.268522:0:5848:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc6b8ac1b0914b17 00000004:00100000:0.0:1788843051.268537:0:5848:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788843051.268850:0:5848:0:(import.c:65:import_set_state_nolock()) ffff8dab7b958800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843051.268913:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875737795633408:12345-0@lo:38: Request processed in 454us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843051.268918:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788843051.268947:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dab6ec4bb80 x1875737795633408/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843051.268954:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788843051.268960:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788843051.268965:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788843051.268968:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788843051.268969:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab7d99d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788843051.268973:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875737795633408:0@lo:38: 00000100:00100000:2.0:1788843051.270830:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843051.270851:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795633536:0@lo:400: 00000100:00100000:2.0:1788843051.270915:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843051.271005:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795633536 00000100:00100000:2.0:1788843051.271013:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795633536 00000100:00100000:2.0:1788843051.271081:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843051.271718:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795633536:12345-0@lo:400: 00000100:00100000:2.0:1788843051.271841:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795633536:12345-0@lo:400: Request processed in 751us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843051.271849:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:2.0:1788843051.272035:0:6714:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1788843051.272134:0:6690:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788843051.272163:0:6690:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788843051.272186:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914afb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914b02 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.272199:0:6690:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914afb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914b02 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788843051.272245:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788843051.272250:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788843051.272252:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843051.272253:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843051.272254:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843051.272255:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843051.272256:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843051.272258:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788843051.272259:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788843051.272260:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843051.272262:0:6690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788843051.272265:0:6690:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788843051.272268:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788843051.272269:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788843051.272270:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843051.272270:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843051.272271:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843051.272272:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843051.272273:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843051.272274:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788843051.272275:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788843051.272276:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843051.272277:0:6690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788843051.272296:0:6690:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788843051.272309:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795633664:0@lo:253: 00000100:00100000:3.0:1788843051.272474:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843051.272526:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab452ec9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843051.272658:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795633664 00000100:00100000:2.0:1788843051.272664:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795633664 00000100:00100000:2.0:1788843051.272702:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788843051.272712:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+13:6690:x1875737795633664:12345-0@lo:253: 20000000:01000000:2.0:1788843051.272735:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788843051.272749:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:0.0:1788843051.274194:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dab6ec49180 x1875737795633536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843051.274213:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795633536:0@lo:400: 20000000:01000000:3.0:1788843051.293141:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788843051.293159:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788843051.293169:0:5862:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788843051.293176:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788843051.293200:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914b1e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.293221:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab82055e00/0xc6b8ac1b0914a7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914a76 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.293231:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914b1e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.293334:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab82055e00/0xc6b8ac1b0914a7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914a76 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843051.293375:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab82055e00/0xc6b8ac1b0914a7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a76 expref: 13 pid: 5839 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843051.293390:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1875737795633792:0@lo:104: 00000100:00100000:1.0:1788843051.293469:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843051.293525:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab71b0fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788843051.293641:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795633792 00000100:00100000:3.0:1788843051.293650:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795633792 00000100:00100000:3.0:1788843051.293695:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843051.293704:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1788843051.293705:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28cf63da-daee-485f-b466-4ec68876f732+3:5862:x1875737795633792:12345-0@lo:104: 00000100:00100000:1.0:1788843051.293715:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1788843051.293721:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914a76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914a7d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843051.293805:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bc000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1875737795633792:0@lo:104: 00010000:00010000:3.0:1788843051.293809:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1788843051.293825:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914b1e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843051.293829:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28cf63da-daee-485f-b466-4ec68876f732+3:5862:x1875737795633792:12345-0@lo:104: Request processed in 124us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843051.293843:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788843051.293867:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843051.293873:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914a76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914a7d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.293880:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4c00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843051.293884:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914a76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914a7d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.293892:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914a7d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843051.293900:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914a76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914a7d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843051.293906:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788843051.293941:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914a76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914a7d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.293948:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843051.293968:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914a76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914a7d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.293975:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914a76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914a7d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.293990:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843051.293991:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843051.293993:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843051.294010:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795633920:0@lo:103: 00000100:00100000:3.0:1788843051.294042:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843051.294083:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795633920 00000100:00100000:3.0:1788843051.294087:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795633920 00010000:00010000:3.0:1788843051.294104:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab82055e00/0xc6b8ac1b0914a7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a76 expref: 14 pid: 5839 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843051.294139:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843051.294146:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51551850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28cf63da-daee-485f-b466-4ec68876f732+14:3305:x1875737795633920:12345-0@lo:103: 00010000:00010000:3.0:1788843051.294157:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843051.294162:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab82055e00/0xc6b8ac1b0914a7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a76 expref: 14 pid: 5839 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.294172:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab82055e00/0xc6b8ac1b0914a7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a76 expref: 14 pid: 5839 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.294186:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab82055e00/0xc6b8ac1b0914a7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914a76 expref: 14 pid: 5839 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.294199:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914b1e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.294208:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914b1e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788843051.294219:0:5832:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001079598s 00010000:00010000:3.0:1788843051.294223:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914b1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.294229:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914b1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.294252:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914b1e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.294258:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914b1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.294263:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933ba00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843051.294267:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914b1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.294275:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914b1e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.294292:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914b1e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.294302:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843051.294401:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51551850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28cf63da-daee-485f-b466-4ec68876f732+13:3305:x1875737795633920:12345-0@lo:103: Request processed in 255us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843051.294409:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788843051.294513:0:5862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914b1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.294522:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914b1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843051.294529:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914b1e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843051.294563:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795633920:0@lo:103: 00000100:00100000:3.0:1788843051.308044:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:6690:x1875737795633664:12345-0@lo:253: Request processed in 35323us (35559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843051.308061:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788843051.308096:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:6690:1875737795633664:0@lo:253: 10000000:01000000:0.0:1788843051.308126:0:6690:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788843051.308130:0:6690:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788843051.308132:0:6690:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788843051.308134:0:6690:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843051.308135:0:6690:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843051.308136:0:6690:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843051.308138:0:6690:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843051.308139:0:6690:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788843051.308140:0:6690:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788843051.308142:0:6690:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788843051.308144:0:6690:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843051.308145:0:6690:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788843051.308162:0:6690:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788843051.312810:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788843051.312954:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788843051.313135:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788843051.313277:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788843051.313504:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788843051.313741:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788843051.315126:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788843051.519985:0:6690:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788843051.519993:0:6690:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788843051.520036:0:6690:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788843051.520099:0:6690:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788843051.520126:0:6690:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788843051.520154:0:6690:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788843051.781471:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843052.804887:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843053.830542:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843054.859942:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843055.876520:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788843055.950409:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788843055.950416:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dab71a20000 from 21 10000000:01000000:2.0:1788843055.950421:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788843055.950472:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0914b25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843055.950484:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0914b25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843055.950494:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0914b25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843055.950533:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795634048:0@lo:101: 00000100:00100000:2.0:1788843055.950609:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843055.950660:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4937c480 going to sleep for 11 seconds 00000100:00100000:2.0:1788843055.950684:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795634048 00000100:00100000:2.0:1788843055.950691:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795634048 00000100:00100000:2.0:1788843055.950732:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788843055.950740:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:5844:x1875737795634048:12345-0@lo:101: 00010000:00010000:2.0:1788843055.950753:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843055.950764:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914b2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914b25 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843055.950786:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914b25 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843055.950795:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914b25 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843055.950805:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c5800, rc 0) 00000100:00100000:2.0:1788843055.950836:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+13:5844:x1875737795634048:12345-0@lo:101: Request processed in 97us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843055.950843:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788843055.950880:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795634048:0@lo:101: 00010000:00010000:2.0:1788843055.950893:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0914b25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914b2c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843055.950902:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0914b25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914b2c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843055.950955:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795634176:0@lo:501: 00000100:00100000:2.0:1788843055.950975:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843055.950988:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4937c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788843055.954224:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795634176 00000100:00100000:3.0:1788843055.954239:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795634176 00000100:00100000:3.0:1788843055.954290:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788843055.954300:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+13:5844:x1875737795634176:12345-0@lo:501: 00000100:00100000:3.0:1788843055.954709:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+13:5844:x1875737795634176:12345-0@lo:501: Request processed in 410us (3730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843055.954719:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788843055.954906:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795634176:0@lo:501: 00000100:00100000:2.0:1788843055.954965:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795634304:0@lo:503: 00000100:00100000:2.0:1788843055.955018:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843055.955309:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4937c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788843055.956324:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795634304 00000100:00100000:3.0:1788843055.956335:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795634304 00000100:00100000:0.0:1788843055.960338:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788843055.960369:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+13:5844:x1875737795634304:12345-0@lo:503: 00000100:00100000:0.0:1788843055.960780:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+13:5844:x1875737795634304:12345-0@lo:503: Request processed in 416us (5760us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843055.960789:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788843055.960884:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795634304:0@lo:503: 00000100:00100000:3.0:1788843055.961455:0:6959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcadc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:6959:1875737795634432:0@lo:502: 00000100:00100000:3.0:1788843055.961506:0:6959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843055.961545:0:6959:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab514a8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788843055.961602:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795634432 00000100:00100000:0.0:1788843055.961609:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795634432 00000100:00100000:0.0:1788843055.961646:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788843055.961656:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+13:6959:x1875737795634432:12345-0@lo:502: 00000100:00100000:0.0:1788843055.961888:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+13:6959:x1875737795634432:12345-0@lo:502: Request processed in 233us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843055.961895:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788843055.961980:0:6959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcadc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:6959:1875737795634432:0@lo:502: 00000100:00100000:3.0:1788843055.962020:0:6959:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcadc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:6959:1875737795634560:0@lo:502: 00000100:00100000:3.0:1788843055.962050:0:6959:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843055.962160:0:6959:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab514a8900 going to sleep for 11 seconds 00000100:00100000:0.0:1788843055.962208:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795634560 00000100:00100000:0.0:1788843055.962212:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795634560 00000100:00100000:0.0:1788843055.962240:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788843055.962247:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+13:6959:x1875737795634560:12345-0@lo:502: 00000100:00100000:0.0:1788843055.962376:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+13:6959:x1875737795634560:12345-0@lo:502: Request processed in 129us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843055.962383:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788843055.962461:0:6959:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcadc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:6959:1875737795634560:0@lo:502: 00000040:00080000:3.0:1788843055.962478:0:6959:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788843055.962625:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788843055.962648:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788843055.962658:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0914b25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914b2c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843055.962669:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0914b25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914b2c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843055.962679:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788843055.962681:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dab71a20000 from 4 10000000:01000000:0.0:1788843055.962684:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788843055.962706:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab40030400/0xc6b8ac1b0914b33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843055.962714:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab40030400/0xc6b8ac1b0914b33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843055.962723:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab40030400/0xc6b8ac1b0914b33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843055.962745:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795634688:0@lo:101: 00000100:00100000:0.0:1788843055.962771:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843055.962825:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51401600 going to sleep for 11 seconds 00000100:00100000:3.0:1788843055.965272:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795634688 00000100:00100000:3.0:1788843055.965285:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795634688 00000100:00100000:3.0:1788843055.965334:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788843055.965366:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+13:5844:x1875737795634688:12345-0@lo:101: 00010000:00010000:3.0:1788843055.965382:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843055.965413:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914b3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914b33 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843055.965439:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914b3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914b33 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843055.965451:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914b3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914b33 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843055.965460:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41532a00, rc 0) 00000100:00100000:3.0:1788843055.965535:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+14:5844:x1875737795634688:12345-0@lo:101: Request processed in 193us (2762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843055.965542:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788843055.965706:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795634688:0@lo:101: 00010000:00010000:1.0:1788843055.965724:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab40030400/0xc6b8ac1b0914b33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914b3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843055.965734:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab40030400/0xc6b8ac1b0914b33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914b3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843055.965794:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795634816:0@lo:256: 00000100:00100000:1.0:1788843055.965834:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843055.965866:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab698b53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843055.966483:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795634816 00000100:00100000:3.0:1788843055.966489:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795634816 00000100:00100000:3.0:1788843055.966524:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788843055.966532:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+14:5844:x1875737795634816:12345-0@lo:256: 20000000:01000000:3.0:1788843055.966546:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788843055.966564:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788843055.966567:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788843055.966648:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+14:5844:x1875737795634816:12345-0@lo:256: Request processed in 116us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843055.966656:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788843055.968926:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795634816:0@lo:256: 10000000:01000000:1.0:1788843055.968985:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788843055.968996:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab40030400/0xc6b8ac1b0914b33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914b3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843055.969007:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab40030400/0xc6b8ac1b0914b33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914b3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843055.969016:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788843055.969018:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788843055.969021:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788843055.969050:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933b600/0xc6b8ac1b0914b41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843055.969058:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab4933b600/0xc6b8ac1b0914b41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843055.969161:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab4933b600/0xc6b8ac1b0914b41 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843055.969179:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795634944:0@lo:101: 00000100:00100000:1.0:1788843055.969229:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843055.969272:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab698b53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843055.970430:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795634944 00000100:00100000:2.0:1788843055.970439:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795634944 00000100:00100000:2.0:1788843055.970492:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788843055.970502:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+14:5844:x1875737795634944:12345-0@lo:101: 00010000:00010000:2.0:1788843055.970516:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843055.970530:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914b48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914b41 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843055.970553:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914b41 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843055.970564:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914b41 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843055.970572:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c5400, rc 0) 00000100:00100000:2.0:1788843055.970633:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+15:5844:x1875737795634944:12345-0@lo:101: Request processed in 132us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843055.970640:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788843055.971311:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795634944:0@lo:101: 00010000:00010000:1.0:1788843055.971331:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab4933b600/0xc6b8ac1b0914b41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914b48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843055.971364:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab4933b600/0xc6b8ac1b0914b41 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914b48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843055.971427:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795635072:0@lo:501: 00000100:00100000:1.0:1788843055.971462:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843055.971492:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab698b53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843055.971548:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795635072 00000100:00100000:3.0:1788843055.971553:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795635072 00000100:00100000:3.0:1788843055.971592:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788843055.971599:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+15:5844:x1875737795635072:12345-0@lo:501: 00000100:00100000:3.0:1788843055.971868:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+15:5844:x1875737795635072:12345-0@lo:501: Request processed in 268us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843055.971885:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788843055.971960:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795635072:0@lo:501: 00000100:00100000:1.0:1788843055.971988:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795635200:0@lo:503: 00000100:00100000:1.0:1788843055.972023:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843055.972042:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab698b53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843055.973294:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795635200 00000100:00100000:3.0:1788843055.973303:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795635200 00000100:00100000:3.0:1788843055.973368:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788843055.973377:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+15:5844:x1875737795635200:12345-0@lo:503: 00000100:00100000:3.0:1788843055.973750:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+15:5844:x1875737795635200:12345-0@lo:503: Request processed in 374us (1726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843055.973758:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788843055.973880:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795635200:0@lo:503: 00000100:00100000:2.0:1788843055.974370:0:6960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:6960:1875737795635328:0@lo:502: 00000100:00100000:2.0:1788843055.974423:0:6960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843055.974452:0:6960:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab71b0f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788843055.974619:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795635328 00000100:00100000:1.0:1788843055.974624:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795635328 00000100:00100000:1.0:1788843055.974652:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788843055.974659:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+15:6960:x1875737795635328:12345-0@lo:502: 00000100:00100000:1.0:1788843055.974890:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+15:6960:x1875737795635328:12345-0@lo:502: Request processed in 230us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843055.974897:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788843055.975187:0:6960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:6960:1875737795635328:0@lo:502: 00000020:01000000:2.0:1788843055.975211:0:6960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788843055.975219:0:6960:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788843055.975226:0:6960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843055.975228:0:6960:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788843055.975234:0:6960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788843055.975238:0:6960:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:2.0:1788843055.975259:0:6960:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788843055.975262:0:6960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788843055.975276:0:6960:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8dab7ffd8000) 00000020:00000080:2.0:1788843055.975295:0:6960:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788843055.975301:0:6960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788843055.975398:0:6960:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788843055.975404:0:6960:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788843055.975411:0:6960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b0914b56 00010000:00080000:2.0:1788843055.975453:0:6960:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dab73d8c800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1788843055.975678:0:6960:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788843056.045505:0:6960:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788843056.045528:0:6960:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788843056.046033:0:6960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843056.046293:0:6960:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843056.046368:0:6960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788843056.046431:0:6960:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788843056.046919:0:6964:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788843056.046924:0:6964:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788843056.047615:0:6960:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788843056.047626:0:6960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788843056.047656:0:6960:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788843056.047680:0:6960:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b8ac1b0914b5d 00000100:00080000:3.0:1788843056.047690:0:6960:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788843056.047696:0:6960:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dab73d8c800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1788843056.047731:0:6960:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab7bcadc00 x1875737795635456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788843056.047798:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795635456:0@lo:8: 00000100:00100000:1.0:1788843056.047870:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788843056.047937:0:6960:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788843056.047999:0:6960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843056.048003:0:6960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843056.048004:0:6960:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788843056.048008:0:6960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843056.048011:0:6960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843056.048018:0:6960:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788843056.048021:0:6960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788843056.048023:0:6960:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788843056.048047:0:6960:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:6960:1875737795635584:0@lo:502: 00000100:00100000:3.0:1788843056.048234:0:6960:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843056.048256:0:6960:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab514a89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843056.048310:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795635712:0@lo:400: 00000100:00100000:3.0:1788843056.048335:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843056.048377:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843056.048383:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795635840:0@lo:400: 00000100:00100000:3.0:1788843056.048408:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843056.048615:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795635584 00000100:00100000:2.0:1788843056.048622:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795635584 00000100:00100000:2.0:1788843056.048665:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788843056.048675:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+15:6960:x1875737795635584:12345-0@lo:502: 00000100:00100000:2.0:1788843056.048892:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+15:6960:x1875737795635584:12345-0@lo:502: Request processed in 218us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843056.048900:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788843056.048940:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795635712 00000100:00100000:2.0:1788843056.048944:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795635712 00000100:00100000:2.0:1788843056.048968:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795635840 00000100:00100000:2.0:1788843056.048976:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795635840 00000100:00100000:2.0:1788843056.049001:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788843056.049007:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795635712:12345-0@lo:400: 00000100:00100000:2.0:1788843056.049047:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795635712:12345-0@lo:400: Request processed in 40us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843056.049053:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788843056.049222:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788843056.049230:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795635840:12345-0@lo:400: 00000100:00100000:2.0:1788843056.049261:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795635840:12345-0@lo:400: Request processed in 33us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843056.049266:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788843056.049287:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788843056.049313:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab7bcae680 x1875737795635840/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843056.049326:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795635840:0@lo:400: 00010000:00080000:2.0:1788843056.049337:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab7bcaf100 x1875737795635712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843056.050463:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795635456 00000100:00100000:0.0:1788843056.050472:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795635456 00000100:00100000:0.0:1788843056.050565:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843056.050572:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875737795635456:12345-0@lo:8: 00010000:00080000:0.0:1788843056.050598:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 180 last 0 00000020:00000080:0.0:1788843056.050626:0:6692:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b8ac1b0914b64 00002000:00100000:0.0:1788843056.050660:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dab4416c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113970 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788843056.050664:0:6692:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1788843056.050668:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788843056.050774:0:6692:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788843056.050903:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788843056.050926:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8dab4416d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843056.051005:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795635712:0@lo:400: 00000100:00100000:2.0:1788843056.051050:0:6960:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:6960:1875737795635584:0@lo:502: 00000020:01000000:2.0:1788843056.051594:0:6960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843056.051601:0:6960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843056.051604:0:6960:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788843056.051608:0:6960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788843056.051730:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788843056.051750:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788843056.051759:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933b600/0xc6b8ac1b0914b41 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914b48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843056.051776:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933b600/0xc6b8ac1b0914b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914b48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843056.051786:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788843056.051789:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dab600719b8 from 1 10000000:01000000:2.0:1788843056.051792:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788843056.051819:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914b6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843056.051827:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914b6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843056.051836:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914b6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843056.051852:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795635968:0@lo:101: 00000100:00100000:2.0:1788843056.051890:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843056.051923:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab71b0f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843056.051973:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795635968 00000100:00100000:2.0:1788843056.051977:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795635968 00000100:00100000:2.0:1788843056.052006:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788843056.052013:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+15:5844:x1875737795635968:12345-0@lo:101: 00010000:00010000:2.0:1788843056.052023:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843056.052033:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914b72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914b6b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843056.052053:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914b6b expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843056.052211:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914b6b expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843056.052219:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4000, rc 0) 00000100:00100000:2.0:1788843056.052250:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+16:5844:x1875737795635968:12345-0@lo:101: Request processed in 238us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843056.052257:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788843056.052292:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795635968:0@lo:101: 00010000:00010000:2.0:1788843056.052303:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914b6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914b72 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843056.052311:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914b6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914b72 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843056.052368:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795636096:0@lo:501: 00000100:00100000:2.0:1788843056.052391:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843056.052410:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab71b0f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843056.052421:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795636096 00000100:00100000:2.0:1788843056.052425:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795636096 00000100:00100000:2.0:1788843056.052445:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788843056.052451:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+16:5844:x1875737795636096:12345-0@lo:501: 00000100:00100000:2.0:1788843056.052658:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+16:5844:x1875737795636096:12345-0@lo:501: Request processed in 206us (264us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843056.052664:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788843056.052693:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795636096:0@lo:501: 10000000:01000000:2.0:1788843056.052714:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788843056.052726:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914b6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914b72 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843056.052733:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914b72 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843056.055619:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875737795635456:12345-0@lo:8: Request processed in 5037us (7739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843056.055634:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788843056.057720:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab7bcadc00 x1875737795635456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788843066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843056.057733:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843056.057743:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788843056.057751:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788843056.057758:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788843056.057761:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab73d8c800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788843056.057777:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788843056.057783:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795635456:0@lo:8: 00000004:00080000:1.0:1788843056.057821:0:6964:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788843056.057953:0:6964:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 180308610896ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788843056.132313:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795636224:0@lo:13: 00000100:00100000:3.0:1788843056.132407:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788843056.132586:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788843056.132645:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795636224 00000100:00100000:3.0:1788843056.132653:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795636224 00000100:00100000:3.0:1788843056.132715:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843056.132725:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875737795636224:12345-0@lo:13: 00002000:00000024:3.0:1788843056.132757:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788843056.132807:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875737795636224:12345-0@lo:13: Request processed in 83us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843056.132814:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788843056.132856:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab7bcace00 x1875737795636224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843056.132874:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795636224:0@lo:13: 00000004:00080000:3.0:1788843056.132893:0:6965:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788843056.132914:0:6965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcace00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6965:1875737795636352:0@lo:7: 00000100:00100000:3.0:1788843056.132938:0:6965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843056.132974:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795636352 00000100:00100000:3.0:1788843056.132978:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795636352 00000100:00100000:3.0:1788843056.133002:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843056.133008:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6965:x1875737795636352:12345-0@lo:7: 00000100:00080000:2.0:1788843056.133135:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843056.133404:0:6965:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab514a83c0 going to sleep for 11 seconds 00002000:00080000:3.0:1788843056.138679:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788843056.138688:0:6694:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788843056.138831:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6965:x1875737795636352:12345-0@lo:7: Request processed in 5818us (5887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843056.138841:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788843056.139329:0:6965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab7bcace00 x1875737795636352/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788843072 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843056.139361:0:6965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcace00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6965:1875737795636352:0@lo:7: 00000004:00080000:0.0:1788843056.139377:0:6965:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788843056.139420:0:6965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd43480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6965:1875737795636480:0@lo:5: 00000100:00100000:0.0:1788843056.139461:0:6965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843056.139554:0:6965:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab5dba83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843056.139864:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795636480 00000100:00100000:3.0:1788843056.139871:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795636480 00000100:00100000:3.0:1788843056.139915:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843056.139925:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6965:x1875737795636480:12345-0@lo:5: 00002000:00080000:3.0:1788843056.139951:0:6693:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788843056.139955:0:6693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788843056.140310:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6965:x1875737795636480:12345-0@lo:5: Request processed in 385us (847us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788843056.140318:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788843056.140436:0:6965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab7cd43480 x1875737795636480/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843072 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843056.140450:0:6965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd43480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6965:1875737795636480:0@lo:5: 00000004:00080000:1.0:1788843056.140461:0:6965:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788843056.140557:0:6965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6965:1875737795636608:0@lo:700: 00000100:00100000:1.0:1788843056.140589:0:6965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843056.140616:0:6965:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4386de40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843056.140684:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795636608 00000100:00100000:3.0:1788843056.140688:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795636608 00000100:00100000:3.0:1788843056.140720:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843056.140728:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6965:x1875737795636608:12345-0@lo:700: 00000100:00100000:3.0:1788843056.140756:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcad880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6701:1875737795636736:0@lo:700: 00000100:00100000:3.0:1788843056.140784:0:6701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843056.140801:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab514a80c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843056.140818:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795636736 00000100:00100000:3.0:1788843056.140822:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795636736 00000100:00100000:3.0:1788843056.140845:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843056.140851:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6701:x1875737795636736:12345-0@lo:700: 40000000:02000000:3.0:1788843056.188268:0:5853:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788843056.197383:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6701:x1875737795636736:12345-0@lo:700: Request processed in 56525us (56591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843056.197397:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788843056.200270:0:6701:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab7bcad880 x1875737795636736/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788843072 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843056.200289:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcad880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6701:1875737795636736:0@lo:700: 40000000:02000000:1.0:1788843056.200307:0:6701:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1788843056.288425:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6965:x1875737795636608:12345-0@lo:700: Request processed in 147688us (147825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843056.288439:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00100000:3.0:1788843056.288474:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788843056.288502:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00010000:00080000:3.0:1788843056.288537:0:6965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab600bd180 x1875737795636608/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788843072 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843056.288552:0:6965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6965:1875737795636608:0@lo:700: 00000004:02000040:3.0:1788843056.361958:0:6965:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788843056.367014:0:6965:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcad880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6965:1875737795636864:0@lo:5: 00000100:00100000:3.0:1788843056.367169:0:6965:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843056.367234:0:6965:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab514a8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788843056.367300:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795636864 00000100:00100000:0.0:1788843056.367308:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795636864 00000100:00100000:0.0:1788843056.367380:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843056.367392:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6965:x1875737795636864:12345-0@lo:5: 00002000:00080000:1.0:1788843056.374413:0:6694:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788843056.374434:0:6694:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788843056.383276:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6965:x1875737795636864:12345-0@lo:5: Request processed in 15877us (16098us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788843056.383290:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788843056.383402:0:6965:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab7bcad880 x1875737795636864/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843072 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843056.383416:0:6965:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788843056.383432:0:6965:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8dab7bcad880 x1875737795636864/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843072 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843056.383444:0:6965:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcad880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6965:1875737795636864:0@lo:5: 00000004:00080000:0.0:1788843056.383462:0:6965:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1788843056.900694:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843057.924788:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788843058.061858:0:7062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788843058.954809:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843059.972491:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843060.998000:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843061.063001:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795636992:0@lo:400: 00000100:00100000:0.0:1788843061.063095:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843061.063145:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843061.063151:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795637376:0@lo:400: 00000100:00100000:0.0:1788843061.063180:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843061.063213:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795637376 00000100:00100000:0.0:1788843061.063220:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795637376 00000100:00100000:0.0:1788843061.063280:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843061.063295:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875737795637376:12345-0@lo:400: 00000100:00100000:0.0:1788843061.063383:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875737795637376:12345-0@lo:400: Request processed in 94us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843061.063391:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788843061.063448:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab600bc700 x1875737795637376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843061.063477:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795637376:0@lo:400: 00000100:00100000:0.0:1788843061.063515:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795637120:0@lo:400: 00000100:00100000:0.0:1788843061.063545:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843061.063562:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843061.063567:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795637248:0@lo:400: 00000100:00100000:0.0:1788843061.063585:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843061.064855:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795636992 00000100:00100000:2.0:1788843061.064868:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795636992 00000100:00100000:2.0:1788843061.064940:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788843061.064951:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+16:3305:x1875737795636992:12345-0@lo:400: 00000100:00100000:3.0:1788843061.065215:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795637120 00000100:00100000:3.0:1788843061.065222:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795637120 00000100:00100000:3.0:1788843061.065266:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795637248 00000100:00100000:3.0:1788843061.065269:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795637248 00000100:00100000:3.0:1788843061.065294:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843061.065302:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795637120:12345-0@lo:400: 00000100:00100000:0.0:1788843061.066962:0:5846:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788843061.066974:0:5846:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:0.0:1788843061.066990:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788843061.066996:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843061.067103:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843061.067116:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795637248:12345-0@lo:400: 00000100:00100000:2.0:1788843061.067417:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+16:3305:x1875737795636992:12345-0@lo:400: Request processed in 2465us (4319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843061.067428:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788843061.067508:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795636992:0@lo:400: 00000100:00100000:3.0:1788843061.067605:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795637120:12345-0@lo:400: Request processed in 2302us (4057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843061.067616:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788843061.067630:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab600bf480 x1875737795637120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843061.067643:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795637120:0@lo:400: 00000100:00100000:0.0:1788843061.068238:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795637248:12345-0@lo:400: Request processed in 1123us (4648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843061.068248:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788843061.068782:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab600bc380 x1875737795637248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843061.068798:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795637248:0@lo:400: 00000100:00100000:0.0:1788843061.592628:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843061.592654:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795637504:0@lo:13: 00000100:00100000:0.0:1788843061.595732:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843061.596807:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795637504 00000100:00100000:3.0:1788843061.596819:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795637504 00000100:00100000:3.0:1788843061.596866:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843061.596877:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875737795637504:12345-0@lo:13: 00002000:00000024:3.0:1788843061.597244:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788843061.597337:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875737795637504:12345-0@lo:13: Request processed in 461us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843061.597363:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788843061.597415:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab7cd43b80 x1875737795637504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843061.597437:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795637504:0@lo:13: 00000001:00080000:1.0:1788843061.657393:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:2.0:1788843062.023561:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843063.044614:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843064.068962:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843065.092984:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843066.119440:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843066.182272:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795637632:0@lo:400: 00000100:00100000:0.0:1788843066.182407:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843066.182457:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843066.182463:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795637760:0@lo:400: 00000100:00100000:0.0:1788843066.182489:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843066.182519:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795637888:0@lo:400: 00000100:00100000:0.0:1788843066.182551:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843066.182569:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843066.182574:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795638016:0@lo:400: 00000100:00100000:0.0:1788843066.182614:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843066.182650:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795637632 00000100:00100000:0.0:1788843066.182657:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795637632 00000100:00100000:0.0:1788843066.182704:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788843066.182714:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+16:3306:x1875737795637632:12345-0@lo:400: 00000100:00100000:0.0:1788843066.182766:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+16:3306:x1875737795637632:12345-0@lo:400: Request processed in 53us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843066.182774:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788843066.182810:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795637760 00000100:00100000:0.0:1788843066.182814:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795637760 00000100:00100000:0.0:1788843066.182839:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795637888 00000100:00100000:0.0:1788843066.182842:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795637888 00000100:00100000:0.0:1788843066.182868:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788843066.182874:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795637760:12345-0@lo:400: 00000100:00100000:0.0:1788843066.182905:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795637760:12345-0@lo:400: Request processed in 32us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843066.182912:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788843066.182923:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788843066.182929:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795637888:12345-0@lo:400: 00000100:00100000:0.0:1788843066.182959:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795637888:12345-0@lo:400: Request processed in 31us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843066.182965:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788843066.182983:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795638016 00000100:00100000:0.0:1788843066.182987:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795638016 00000100:00100000:0.0:1788843066.183036:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843066.183042:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795638016:12345-0@lo:400: 00000100:00100000:0.0:1788843066.183070:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795638016:12345-0@lo:400: Request processed in 29us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843066.183075:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788843066.183093:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843066.183098:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788843066.183125:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab7cd40700 x1875737795638016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843066.183135:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788843066.183149:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795638016:0@lo:400: 00010000:00080000:0.0:1788843066.183158:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab7cd41c00 x1875737795637888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843066.183165:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795637888:0@lo:400: 00010000:00080000:0.0:1788843066.183185:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab7cd43100 x1875737795637760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843066.183192:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795637760:0@lo:400: 00000100:00100000:0.0:1788843066.183199:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795637632:0@lo:400: 00000100:00100000:3.0:1788843066.693569:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843066.693595:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795638144:0@lo:13: 00000100:00100000:3.0:1788843066.693666:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843066.693778:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795638144 00000100:00100000:0.0:1788843066.693786:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795638144 00000100:00100000:0.0:1788843066.693836:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843066.693846:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795638144:12345-0@lo:13: 00002000:00000024:0.0:1788843066.693891:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843066.693938:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795638144:12345-0@lo:13: Request processed in 94us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843066.693958:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788843066.693998:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab7fc7a680 x1875737795638144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843066.694032:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795638144:0@lo:13: 00010000:00010000:3.0:1788843067.140490:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843068.164633:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788843068.915573:0:7631:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788843068.915577:0:7631:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788843068.916562:0:7631:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dab51a7d800 00000020:01000004:0.0:1788843068.916582:0:7631:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788843068.916596:0:7631:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788843068.916610:0:7631:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8dab440ecd28) 00000020:00000080:0.0:1788843068.916626:0:7631:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788843068.962696:0:7631:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788843068.963261:0:7631:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788843069.005788:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788843069.015893:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788843069.015930:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788843069.016003:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788843069.016042:0:7631:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788843069.018325:0:7631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788843069.018370:0:7631:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788843069.018384:0:7631:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc6b8ac1b0914b80 00000020:01000004:2.0:1788843069.018392:0:7631:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788843069.018414:0:7631:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788843069.018419:0:7631:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788843069.018425:0:7631:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788843069.020747:0:7631:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788843069.020757:0:7631:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788843069.051310:0:7631:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788843069.051520:0:7631:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.129@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788843069.051524:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788843069.051530:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788843069.051531:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843069.051532:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843069.051533:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843069.051534:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843069.051535:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843069.051537:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788843069.051538:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788843069.051539:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843069.051541:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788843069.051544:0:7631:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788843069.051546:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788843069.051547:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788843069.051548:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843069.051548:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843069.051549:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843069.051550:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843069.051551:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843069.051552:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788843069.051552:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788843069.051553:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843069.051554:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788843069.051586:0:7631:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788843069.051731:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795638272:0@lo:253: 00000100:00100000:3.0:1788843069.051802:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843069.051915:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46b77840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843069.051999:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795638272 00000100:00100000:2.0:1788843069.052005:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795638272 00000100:00100000:2.0:1788843069.052085:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788843069.052094:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+16:7631:x1875737795638272:12345-0@lo:253: 20000000:01000000:2.0:1788843069.052136:0:5840:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788843069.052140:0:5840:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788843069.052145:0:5840:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788843069.052148:0:5840:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788843069.053844:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843069.054115:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788843069.054130:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788843069.054167:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788843069.054176:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788843069.054206:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788843069.054292:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788843069.055132:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788843069.055156:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.129@tcp 20000000:01000000:2.0:1788843069.055159:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:2.0:1788843069.055202:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788843069.055210:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788843069.055282:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788843069.055293:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:2.0:1788843069.055326:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788843069.055335:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788843069.055679:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788843069.055738:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788843069.056717:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1788843069.056741:0:5840:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.129@tcp 20000000:01000000:2.0:1788843069.056744:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.129@tcp (null) (null) (null) 00000040:00080000:2.0:1788843069.056778:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1788843069.056786:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788843069.056815:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1788843069.056821:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.129@tcp (null) (null) 00000040:00080000:2.0:1788843069.056850:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1788843069.056858:0:5840:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788843069.056901:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1788843069.056935:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1788843069.056952:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788843069.056954:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788843069.056960:0:5840:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788843069.056961:0:5840:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788843069.056963:0:5840:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788843069.056975:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788843069.056978:0:5840:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788843069.057017:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788843069.057019:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788843069.057743:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788843069.057800:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788843069.057853:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788843069.058121:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788843069.058153:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788843069.058203:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788843069.058215:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788843069.058227:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788843069.058724:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788843069.058937:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788843069.058971:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788843069.059041:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788843069.059052:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788843069.059054:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788843069.060041:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1788843069.060110:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1788843069.060165:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788843069.060519:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788843069.060562:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788843069.060822:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788843069.060840:0:5840:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788843069.060842:0:5840:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788843069.061656:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1788843069.061731:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1788843069.061764:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788843069.062101:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788843069.062144:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788843069.062199:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:3.0:1788843069.062217:0:5840:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788843069.062235:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914b87 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.062253:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab41533e00/0xc6b8ac1b0914ad8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914ad1 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.062260:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914b02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914afb expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.062275:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914b2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914b25 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.062282:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914b48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914b41 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.062289:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914b72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914b6b expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.062295:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914b87 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.062332:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914b72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914b6b expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.062390:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914b72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b6b expref: 16 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843069.062405:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcaf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875737795638400:0@lo:104: 00000100:00100000:3.0:1788843069.062479:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788843069.062527:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914b41 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.062537:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914b48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b41 expref: 16 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843069.062544:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875737795638528:0@lo:104: 00010000:00010000:3.0:1788843069.062582:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914b25 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.062610:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914b2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b25 expref: 16 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843069.062619:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875737795638656:0@lo:104: 00010000:00010000:3.0:1788843069.062646:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914afb expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.062654:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914b02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914afb expref: 16 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843069.062662:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcae300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875737795638784:0@lo:104: 00010000:00010000:3.0:1788843069.062684:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab41533e00/0xc6b8ac1b0914ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914ad1 expref: 16 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.062691:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab41533e00/0xc6b8ac1b0914ad8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914ad1 expref: 16 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843069.062699:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcadf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875737795638912:0@lo:104: 00000100:00100000:3.0:1788843069.062717:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46b77cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843069.062926:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788843069.062945:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843069.062971:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843069.062996:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843069.063008:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843069.063017:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795638400 00000100:00100000:0.0:1788843069.063023:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795638400 00000100:00100000:0.0:1788843069.063051:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795638528 00000100:00100000:0.0:1788843069.063053:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795638528 00000100:00100000:0.0:1788843069.063061:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795638656 00000100:00100000:0.0:1788843069.063063:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795638656 00000100:00100000:0.0:1788843069.063081:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795638784 00000100:00100000:0.0:1788843069.063084:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795638784 00000100:00100000:0.0:1788843069.063092:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795638912 00000100:00100000:0.0:1788843069.063094:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795638912 00000100:00100000:0.0:1788843069.063105:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843069.063112:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43763450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+7:5840:x1875737795638400:12345-0@lo:104: 00010000:00010000:0.0:1788843069.063124:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914b72 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.063175:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788843069.063181:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43763450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+7:5840:x1875737795638400:12345-0@lo:104: Request processed in 70us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843069.063188:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843069.063239:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788843069.063246:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+6:5840:x1875737795638528:12345-0@lo:104: 00010000:00010000:0.0:1788843069.063253:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab4933b600/0xc6b8ac1b0914b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914b48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.063284:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788843069.063289:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc7a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+6:5840:x1875737795638528:12345-0@lo:104: Request processed in 45us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843069.063295:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788843069.063306:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788843069.063311:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+5:5840:x1875737795638656:12345-0@lo:104: 00010000:00010000:0.0:1788843069.063317:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0914b25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914b2c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.063370:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788843069.063375:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+5:5840:x1875737795638656:12345-0@lo:104: Request processed in 65us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843069.063387:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788843069.063398:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788843069.063404:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+4:5840:x1875737795638784:12345-0@lo:104: 00010000:00010000:0.0:1788843069.063411:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914afb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914b02 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.063510:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788843069.063516:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+4:5840:x1875737795638784:12345-0@lo:104: Request processed in 113us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843069.063522:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788843069.063534:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788843069.063540:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+3:5840:x1875737795638912:12345-0@lo:104: 00010000:00010000:0.0:1788843069.063547:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab4933b400/0xc6b8ac1b0914ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914ad8 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.063574:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788843069.063579:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+3:5840:x1875737795638912:12345-0@lo:104: Request processed in 40us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843069.063584:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788843069.063724:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788843069.063731:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914b72 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.063739:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4c00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843069.063742:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914b6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914b72 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.063760:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914b72 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843069.063767:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914b6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914b72 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843069.063773:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843069.063910:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914b6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914b72 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.063917:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843069.063947:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914b6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914b72 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.063955:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914b6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914b72 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.063970:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788843069.063973:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab4933b600/0xc6b8ac1b0914b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914b48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.063979:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b600 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843069.063982:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933b600/0xc6b8ac1b0914b41 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914b48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.063997:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab4933b600/0xc6b8ac1b0914b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914b48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843069.064002:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933b600/0xc6b8ac1b0914b41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914b48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843069.064014:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788843069.064056:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795639040:0@lo:103: 00000100:00100000:3.0:1788843069.064091:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843069.064206:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795639040 00000100:00100000:1.0:1788843069.064211:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795639040 00010000:00010000:1.0:1788843069.064232:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914b72 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b6b expref: 17 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843069.064257:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843069.064263:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+17:3307:x1875737795639040:12345-0@lo:103: 00010000:00010000:1.0:1788843069.064274:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843069.064280:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914b72 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b6b expref: 17 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.064291:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914b72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b6b expref: 17 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.064307:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843069.064362:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+17:3307:x1875737795639040:12345-0@lo:103: Request processed in 77us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843069.064369:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843069.064404:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795639040:0@lo:103: 00010000:00010000:1.0:1788843069.064515:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914b72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914b6b expref: 16 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843069.064534:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcaf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875737795638400:0@lo:104: 00000100:00100000:1.0:1788843069.064546:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875737795638528:0@lo:104: 00000100:00100000:1.0:1788843069.064553:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875737795638656:0@lo:104: 00000100:00100000:1.0:1788843069.064561:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcae300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875737795638784:0@lo:104: 00000100:00100000:1.0:1788843069.064569:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcadf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5840:1875737795638912:0@lo:104: 00010000:00010000:1.0:1788843069.064592:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914b87 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.064624:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788843069.064748:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843069.064755:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0914b25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914b2c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.064762:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4a00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:1.0:1788843069.064766:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0914b25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914b2c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.064772:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0914b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914b2c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843069.064778:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0914b25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914b2c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843069.064783:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843069.065211:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab4933b600/0xc6b8ac1b0914b41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914b48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.065218:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843069.065245:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab4933b600/0xc6b8ac1b0914b41 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914b48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.065252:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab4933b600/0xc6b8ac1b0914b41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914b48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.065263:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843069.065266:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab4933b400/0xc6b8ac1b0914ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914ad8 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.065271:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b400 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843069.065274:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933b400/0xc6b8ac1b0914ad1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914ad8 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.065280:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab4933b400/0xc6b8ac1b0914ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914ad8 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843069.065287:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933b400/0xc6b8ac1b0914ad1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914ad8 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843069.065292:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843069.065306:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab4933b400/0xc6b8ac1b0914ad1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914ad8 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.065312:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843069.065325:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab4933b400/0xc6b8ac1b0914ad1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914ad8 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.065332:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab4933b400/0xc6b8ac1b0914ad1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914ad8 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.065356:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843069.065358:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843069.065360:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843069.065371:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795639296:0@lo:103: 00000100:00100000:0.0:1788843069.065416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843069.065528:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795639168:0@lo:103: 00000100:00100000:3.0:1788843069.065556:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843069.065774:0:5835:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0914b25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914b2c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.065791:0:5835:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843069.065805:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0914b25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914b2c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.065811:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c4a00/0xc6b8ac1b0914b25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914b2c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.065822:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843069.065824:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843069.065826:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843069.065835:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795639424:0@lo:103: 00000100:00100000:1.0:1788843069.065861:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843069.065893:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795639296 00000100:00100000:1.0:1788843069.065899:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795639296 00010000:00010000:1.0:1788843069.065921:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab41533e00/0xc6b8ac1b0914ad8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914ad1 expref: 16 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843069.065941:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795639168 00000100:00100000:1.0:1788843069.065944:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795639168 00010000:00010000:1.0:1788843069.065954:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914b48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b41 expref: 17 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843069.065964:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795639424 00000100:00100000:1.0:1788843069.065966:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795639424 00010000:00010000:1.0:1788843069.065974:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914b2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b25 expref: 18 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843069.065994:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843069.066002:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+18:3305:x1875737795639296:12345-0@lo:103: 00010000:00010000:1.0:1788843069.066020:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843069.066026:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab41533e00/0xc6b8ac1b0914ad8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914ad1 expref: 18 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.066035:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab41533e00/0xc6b8ac1b0914ad8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914ad1 expref: 18 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.066047:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab41533e00/0xc6b8ac1b0914ad8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914ad1 expref: 18 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.066060:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843069.066093:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+17:3305:x1875737795639296:12345-0@lo:103: Request processed in 91us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843069.066099:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843069.066114:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843069.066120:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+16:3304:x1875737795639168:12345-0@lo:103: 00010000:00010000:1.0:1788843069.066127:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843069.066131:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914b48 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b41 expref: 16 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843069.066198:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788843069.066206:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+16:3306:x1875737795639424:12345-0@lo:103: 00010000:00010000:3.0:1788843069.066213:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843069.066227:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914b2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b25 expref: 16 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843069.066255:0:5832:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788843069.066262:0:5832:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1788843069.066297:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795639296:0@lo:103: 00010000:00010000:1.0:1788843069.066877:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914b48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b41 expref: 16 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.066927:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914b2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b25 expref: 16 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.066941:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914b2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914b25 expref: 16 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.066953:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843069.067009:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+15:3306:x1875737795639424:12345-0@lo:103: Request processed in 804us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843069.067017:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788843069.067079:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795639424:0@lo:103: 00010000:00010000:1.0:1788843069.067122:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914b48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914b41 expref: 14 pid: 5839 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.067131:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843069.067200:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+13:3304:x1875737795639168:12345-0@lo:103: Request processed in 1079us (1642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843069.067207:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788843069.067689:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843069.067692:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843069.067694:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843069.067729:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914afb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914b02 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.067739:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40031c00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:1.0:1788843069.067742:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914afb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914b02 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.067751:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914afb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914b02 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843069.067757:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914afb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914b02 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843069.067762:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788843069.067832:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914afb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914b02 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.067839:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843069.067864:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914afb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914b02 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.067872:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914afb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914b02 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843069.067891:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843069.067903:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795639552:0@lo:103: 00000100:00100000:1.0:1788843069.067938:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843069.067971:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843069.067973:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843069.067975:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843069.068116:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795639168:0@lo:103: 00000100:00100000:2.0:1788843069.068241:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795639552 00000100:00100000:2.0:1788843069.068247:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795639552 00010000:00010000:2.0:1788843069.068270:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914b02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914afb expref: 13 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843069.068302:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843069.068310:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28cf63da-daee-485f-b466-4ec68876f732+13:3306:x1875737795639552:12345-0@lo:103: 00010000:00010000:2.0:1788843069.068321:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843069.068326:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914b02 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914afb expref: 13 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843069.068335:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914b02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914afb expref: 13 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843069.068476:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914b02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914afb expref: 13 pid: 5841 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843069.068488:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914b87 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843069.068504:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914b87 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.068694:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914b87 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.068707:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914b87 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.068714:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914b87 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.068721:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914b87 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.068727:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41533600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843069.068731:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914b87 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.068739:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914b87 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.068902:0:5840:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914b87 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.068910:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914b87 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788843069.068919:0:5840:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00010000:00010000:1.0:1788843069.078794:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914b87 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.078813:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914b87 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.078833:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843069.078928:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28cf63da-daee-485f-b466-4ec68876f732+12:3306:x1875737795639552:12345-0@lo:103: Request processed in 10615us (10985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843069.078937:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788843069.079592:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795639552:0@lo:103: 00000100:00100000:2.0:1788843069.135671:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+11:7631:x1875737795638272:12345-0@lo:253: Request processed in 83569us (83860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843069.135684:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788843069.135767:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795638272:0@lo:253: 10000000:01000000:3.0:1788843069.135782:0:7631:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788843069.135786:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788843069.135787:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788843069.135788:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843069.135790:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1788843069.135791:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843069.135792:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843069.135793:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843069.135806:0:7631:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788843069.135807:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843069.135808:0:7631:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788843069.135827:0:7631:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dab51a7d800 from lustre-OST0001 10000000:01000000:3.0:1788843069.135849:0:7631:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788843069.135852:0:7631:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788843069.135859:0:7631:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dab600719b8 local copy 10000000:01000000:3.0:1788843069.135862:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788843069.136135:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0914b8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.136147:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0914b8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.136158:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0914b8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843069.136178:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795639680:0@lo:101: 00000100:00100000:3.0:1788843069.136218:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843069.136362:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46b77240 going to sleep for 11 seconds 00000100:00100000:0.0:1788843069.136577:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795639680 00000100:00100000:0.0:1788843069.136585:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795639680 00000100:00100000:0.0:1788843069.136662:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788843069.136671:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+11:7631:x1875737795639680:12345-0@lo:101: 00010000:00010000:0.0:1788843069.136683:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843069.136697:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab40030800/0xc6b8ac1b0914b95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914b8e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.136719:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab40030800/0xc6b8ac1b0914b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914b8e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.136742:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab40030800/0xc6b8ac1b0914b95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914b8e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.136750:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab40030800, rc 0) 00000100:00100000:0.0:1788843069.136837:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:7631:x1875737795639680:12345-0@lo:101: Request processed in 167us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843069.136844:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788843069.137067:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795639680:0@lo:101: 00010000:00010000:3.0:1788843069.137081:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0914b8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xc6b8ac1b0914b95 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.137090:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0914b8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc6b8ac1b0914b95 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843069.137201:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795639808:0@lo:501: 00000100:00100000:3.0:1788843069.137230:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843069.137308:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46b77240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843069.137544:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795639808 00000100:00100000:2.0:1788843069.137549:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795639808 00000100:00100000:2.0:1788843069.137612:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788843069.137620:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:7631:x1875737795639808:12345-0@lo:501: 00000100:00100000:2.0:1788843069.137827:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:7631:x1875737795639808:12345-0@lo:501: Request processed in 208us (595us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843069.137834:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788843069.137905:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795639808:0@lo:501: 10000000:01000000:3.0:1788843069.137923:0:7631:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788843069.137947:0:7631:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788843069.137952:0:7631:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0914b8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xc6b8ac1b0914b95 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.137971:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0914b8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc6b8ac1b0914b95 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.137978:0:7631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0914b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xc6b8ac1b0914b95 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.138011:0:7631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788843069.138030:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dab51a7d800 10000000:01000000:3.0:1788843069.138034:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788843069.138039:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788843069.138041:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788843069.138045:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788843069.138048:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788843069.138064:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41532e00/0xc6b8ac1b0914b9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.138072:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab41532e00/0xc6b8ac1b0914b9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.138081:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab41532e00/0xc6b8ac1b0914b9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843069.138093:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795639936:0@lo:101: 00000100:00100000:3.0:1788843069.138118:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843069.138162:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843069.138169:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0914b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc6b8ac1b0914b95 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.138186:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41533200 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:1.0:1788843069.138190:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0914b8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xc6b8ac1b0914b95 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.138198:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0914b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xc6b8ac1b0914b95 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843069.138205:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0914b8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xc6b8ac1b0914b95 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843069.138210:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788843069.138228:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0914b8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6b8ac1b0914b95 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.138234:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843069.138253:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0914b8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6b8ac1b0914b95 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.138260:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab41533200/0xc6b8ac1b0914b8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xc6b8ac1b0914b95 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.138272:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843069.138274:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843069.138276:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843069.138287:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795640064:0@lo:103: 00000100:00100000:1.0:1788843069.138317:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843069.138409:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795640064 00000100:00100000:1.0:1788843069.138414:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795640064 00000100:00100000:1.0:1788843069.138445:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843069.138458:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+12:3304:x1875737795640064:12345-0@lo:103: 00010000:00010000:1.0:1788843069.138469:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843069.138481:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab40030800/0xc6b8ac1b0914b95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0914b8e expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.138494:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843069.138521:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+11:3304:x1875737795640064:12345-0@lo:103: Request processed in 64us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843069.138527:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843069.138559:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795640064:0@lo:103: 00000100:00100000:3.0:1788843069.139262:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46b770c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843069.139307:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795639936 00000100:00100000:0.0:1788843069.139313:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795639936 00000100:00100000:2.0:1788843069.139386:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788843069.139396:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+11:7631:x1875737795639936:12345-0@lo:101: 00010000:00010000:2.0:1788843069.139414:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843069.139427:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab821c4200/0xc6b8ac1b0914ba3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914b9c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843069.139445:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c4200/0xc6b8ac1b0914ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914b9c expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843069.139456:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab821c4200/0xc6b8ac1b0914ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914b9c expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843069.139464:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4200, rc 0) 00000100:00100000:2.0:1788843069.139506:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:7631:x1875737795639936:12345-0@lo:101: Request processed in 113us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843069.139521:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788843069.139758:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795639936:0@lo:101: 00010000:00010000:3.0:1788843069.139771:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab41532e00/0xc6b8ac1b0914b9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914ba3 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.139779:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab41532e00/0xc6b8ac1b0914b9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914ba3 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843069.139870:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795640192:0@lo:501: 00000100:00100000:3.0:1788843069.139914:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843069.139940:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46b770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843069.140267:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795640192 00000100:00100000:1.0:1788843069.140272:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795640192 00000100:00100000:1.0:1788843069.140292:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788843069.140299:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:7631:x1875737795640192:12345-0@lo:501: 00000100:00100000:1.0:1788843069.140556:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:7631:x1875737795640192:12345-0@lo:501: Request processed in 256us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843069.140562:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788843069.140736:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795640192:0@lo:501: 00000100:00100000:3.0:1788843069.140766:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795640320:0@lo:503: 00000100:00100000:3.0:1788843069.140801:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843069.140828:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46b770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843069.141050:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795640320 00000100:00100000:1.0:1788843069.141054:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795640320 00000100:00100000:1.0:1788843069.141075:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788843069.141081:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:7631:x1875737795640320:12345-0@lo:503: 00000100:00100000:1.0:1788843069.141269:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+12:7631:x1875737795640320:12345-0@lo:503: Request processed in 187us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843069.141276:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788843069.141680:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795640320:0@lo:503: 00000040:00080000:2.0:1788843069.142195:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788843069.142257:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795640448:0@lo:502: 00000100:00100000:2.0:1788843069.142308:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843069.142614:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab50c45780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843069.142679:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795640448 00000100:00100000:0.0:1788843069.142685:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795640448 00000100:00100000:0.0:1788843069.142755:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788843069.142763:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:7631:x1875737795640448:12345-0@lo:502: 00000100:00100000:0.0:1788843069.143227:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:7631:x1875737795640448:12345-0@lo:502: Request processed in 463us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843069.143234:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788843069.143308:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795640448:0@lo:502: 00000040:00080000:2.0:1788843069.143806:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788843069.143859:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788843069.144209:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788843069.144254:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788843069.144285:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788843069.144312:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788843069.144541:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795640576:0@lo:502: 00000100:00100000:2.0:1788843069.144596:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843069.144674:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab50c45780 going to sleep for 11 seconds 00000100:00100000:1.0:1788843069.144721:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795640576 00000100:00100000:1.0:1788843069.144727:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795640576 00000100:00100000:1.0:1788843069.144808:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788843069.144823:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:7631:x1875737795640576:12345-0@lo:502: 00000100:00100000:1.0:1788843069.145166:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+12:7631:x1875737795640576:12345-0@lo:502: Request processed in 345us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843069.145174:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788843069.145245:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795640576:0@lo:502: 00000040:00080000:2.0:1788843069.145333:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788843069.145363:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1788843069.146190:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788843069.146199:0:7641:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788843069.146205:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843069.146207:0:7641:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788843069.146212:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788843069.146227:0:7641:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8dab7ffd99b8) 00000020:00000080:2.0:1788843069.146247:0:7641:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788843069.146252:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788843069.146320:0:7641:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dab51a7d800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788843069.146327:0:7641:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788843069.146337:0:7641:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc6b8ac1b0914bb1 00010000:00010000:0.0:1788843069.152671:0:7641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1788843069.153140:0:7641:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1788843069.160378:0:7641:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788843069.160722:0:7641:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1788843069.172815:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1788843069.175249:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788843069.181263:0:7641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788843069.181276:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843069.181284:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843069.181286:0:7641:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788843069.181289:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843069.181292:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843069.181293:0:7641:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788843069.181296:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788843069.181298:0:7641:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788843069.183446:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843069.183461:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843069.183464:0:7641:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788843069.183469:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788843069.187106:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1788843069.187147:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788843069.187171:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41532e00/0xc6b8ac1b0914b9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914ba3 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.187195:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab41532e00/0xc6b8ac1b0914b9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914ba3 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843069.187205:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab51a7d800 from 1 10000000:01000000:0.0:1788843069.187207:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843069.187254:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab40031000/0xc6b8ac1b0914bb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.187262:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab40031000/0xc6b8ac1b0914bb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843069.187273:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab40031000/0xc6b8ac1b0914bb8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843069.187297:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795640704:0@lo:101: 00000100:00100000:0.0:1788843069.187393:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843069.188109:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab515973c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843069.189076:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795640704 00000100:00100000:2.0:1788843069.189087:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795640704 00000100:00100000:2.0:1788843069.189147:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788843069.189157:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:7631:x1875737795640704:12345-0@lo:101: 00010000:00010000:2.0:1788843069.189173:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843069.189192:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914bbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914bb8 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843069.189220:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914bbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914bb8 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843069.189231:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914bbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914bb8 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843069.189252:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c5400, rc 0) 00000100:00100000:2.0:1788843069.189326:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+13:7631:x1875737795640704:12345-0@lo:101: Request processed in 171us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843069.189333:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1788843069.189501:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843069.189832:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc7b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795640704:0@lo:101: 00010000:00010000:3.0:1788843069.189853:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab40031000/0xc6b8ac1b0914bb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914bbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.189864:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab40031000/0xc6b8ac1b0914bb8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914bbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843069.190777:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795640832:0@lo:501: 00000100:00100000:3.0:1788843069.190835:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843069.190891:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795640832 00000100:00100000:1.0:1788843069.190898:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795640832 00000100:00100000:1.0:1788843069.191106:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788843069.191116:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+13:7631:x1875737795640832:12345-0@lo:501: 00000100:00100000:3.0:1788843069.191748:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46b770c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843069.193069:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+13:7631:x1875737795640832:12345-0@lo:501: Request processed in 1949us (2228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843069.193080:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788843069.195314:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795640832:0@lo:501: 00000100:00100000:2.0:1788843069.195408:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795640960:0@lo:503: 00000100:00100000:2.0:1788843069.195486:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843069.195545:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab50c45780 going to sleep for 11 seconds 00000100:00100000:1.0:1788843069.195548:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795640960 00000100:00100000:1.0:1788843069.195557:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795640960 00000100:00100000:1.0:1788843069.195621:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788843069.195632:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+13:7631:x1875737795640960:12345-0@lo:503: 00000100:00100000:1.0:1788843069.196024:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+13:7631:x1875737795640960:12345-0@lo:503: Request processed in 393us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843069.196034:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788843069.196045:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795640960:0@lo:503: 00000040:00080000:2.0:1788843069.196335:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788843069.196426:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795641088:0@lo:502: 00000100:00100000:2.0:1788843069.196467:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843069.196506:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795641088 00000100:00100000:2.0:1788843069.196511:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab50c45780 going to sleep for 11 seconds 00000100:00100000:1.0:1788843069.196512:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795641088 00000100:00100000:1.0:1788843069.196544:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788843069.196553:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+13:7631:x1875737795641088:12345-0@lo:502: 00000100:00100000:1.0:1788843069.196831:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+13:7631:x1875737795641088:12345-0@lo:502: Request processed in 279us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843069.196840:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788843069.196857:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795641088:0@lo:502: 00000040:00080000:2.0:1788843069.197096:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788843069.197144:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788843069.197167:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795641216:0@lo:502: 00000100:00100000:2.0:1788843069.197203:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843069.197762:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab50c45780 going to sleep for 11 seconds 00000100:00100000:1.0:1788843069.197865:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795641216 00000100:00100000:1.0:1788843069.197876:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795641216 00000100:00100000:1.0:1788843069.197923:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788843069.197931:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+13:7631:x1875737795641216:12345-0@lo:502: 00000100:00100000:1.0:1788843069.198126:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+13:7631:x1875737795641216:12345-0@lo:502: Request processed in 196us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843069.198134:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788843069.198192:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795641216:0@lo:502: 00000040:00080000:2.0:1788843069.198322:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788843069.198334:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788843069.199839:0:7645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843069.199851:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843069.199853:0:7645:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788843069.199866:0:7645:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dab51a7d800 00000020:00000080:0.0:1788843069.199868:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843069.200325:0:7645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843069.200330:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843069.200332:0:7645:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788843069.200337:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788843069.207131:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788843069.207174:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843069.207202:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab40031000/0xc6b8ac1b0914bb8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914bbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.207215:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab40031000/0xc6b8ac1b0914bb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914bbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843069.207338:0:7631:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788843069.207374:0:7631:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dab51a7d800 10000000:01000000:3.0:1788843069.207377:0:7631:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dab51a7d800 10000000:01000000:3.0:1788843069.207383:0:7631:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788843069.207389:0:7631:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dab51a7d800 from 1 10000000:01000000:3.0:1788843069.207392:0:7631:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788843069.207426:0:7631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41532400/0xc6b8ac1b0914bc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.207436:0:7631:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab41532400/0xc6b8ac1b0914bc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.207447:0:7631:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab41532400/0xc6b8ac1b0914bc6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843069.207471:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795641344:0@lo:101: 00000100:00100000:3.0:1788843069.207540:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843069.207591:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46b77180 going to sleep for 11 seconds 00000100:00100000:2.0:1788843069.207612:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795641344 00000100:00100000:2.0:1788843069.207621:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795641344 00000100:00100000:2.0:1788843069.207679:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788843069.207689:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+13:7631:x1875737795641344:12345-0@lo:101: 00010000:00010000:2.0:1788843069.207702:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843069.207715:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab821c4a00/0xc6b8ac1b0914bcd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914bc6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843069.207761:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c4a00/0xc6b8ac1b0914bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914bc6 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843069.207770:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab821c4a00/0xc6b8ac1b0914bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914bc6 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843069.207779:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4a00, rc 0) 00000100:00100000:2.0:1788843069.207833:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+14:7631:x1875737795641344:12345-0@lo:101: Request processed in 145us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843069.207840:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788843069.207863:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795641344:0@lo:101: 00010000:00010000:3.0:1788843069.207880:0:7631:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab41532400/0xc6b8ac1b0914bc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914bcd expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.208012:0:7631:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab41532400/0xc6b8ac1b0914bc6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914bcd expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843069.208110:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795641472:0@lo:501: 00000100:00100000:3.0:1788843069.208138:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843069.209434:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46b77180 going to sleep for 11 seconds 00000100:00100000:0.0:1788843069.213588:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795641472 00000100:00100000:0.0:1788843069.213603:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795641472 00000100:00100000:0.0:1788843069.214660:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788843069.214679:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+14:7631:x1875737795641472:12345-0@lo:501: 00000100:00100000:0.0:1788843069.215023:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+14:7631:x1875737795641472:12345-0@lo:501: Request processed in 350us (6883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843069.215031:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788843069.215134:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795641472:0@lo:501: 00000100:00100000:3.0:1788843069.215184:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795641600:0@lo:503: 00000100:00100000:3.0:1788843069.215237:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843069.217755:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46b77180 going to sleep for 11 seconds 00000100:00100000:2.0:1788843069.221318:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795641600 00000100:00100000:2.0:1788843069.221332:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795641600 00000100:00100000:2.0:1788843069.221462:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788843069.221472:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+14:7631:x1875737795641600:12345-0@lo:503: 00000100:00100000:2.0:1788843069.222322:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+14:7631:x1875737795641600:12345-0@lo:503: Request processed in 848us (7081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843069.222331:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788843069.222382:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795641600:0@lo:503: 00000040:00080000:3.0:1788843069.222683:0:7631:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788843069.222759:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795641728:0@lo:502: 00000100:00100000:3.0:1788843069.222808:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843069.223551:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795641728 00000100:00100000:2.0:1788843069.223559:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795641728 00000100:00100000:2.0:1788843069.223635:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788843069.223645:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+14:7631:x1875737795641728:12345-0@lo:502: 00000100:00100000:3.0:1788843069.224237:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46b77180 going to sleep for 11 seconds 00000100:00100000:2.0:1788843069.226240:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+14:7631:x1875737795641728:12345-0@lo:502: Request processed in 2588us (3424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843069.226254:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788843069.226497:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795641728:0@lo:502: 00000040:00080000:3.0:1788843069.226944:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788843069.227012:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788843069.227048:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788843069.227093:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788843069.227129:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788843069.227198:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788843069.227235:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788843069.227270:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788843069.227509:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788843069.227599:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788843069.227646:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788843069.227793:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788843069.227833:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788843069.227868:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788843069.227910:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788843069.227938:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788843069.227969:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788843069.228028:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788843069.228057:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788843069.228086:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788843069.228197:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788843069.228243:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788843069.228280:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788843069.228364:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788843069.228405:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788843069.228440:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788843069.228496:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788843069.228722:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788843069.228745:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788843069.228772:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788843069.228790:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788843069.228806:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788843069.228822:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788843069.228845:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788843069.228862:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788843069.228885:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788843069.228915:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788843069.228955:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795641856:0@lo:502: 00000100:00100000:3.0:1788843069.229035:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843069.229090:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46b77180 going to sleep for 11 seconds 00000100:00100000:2.0:1788843069.229121:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795641856 00000100:00100000:2.0:1788843069.229130:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795641856 00000100:00100000:2.0:1788843069.229182:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788843069.229197:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+14:7631:x1875737795641856:12345-0@lo:502: 00000100:00100000:3.0:1788843069.232668:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+14:7631:x1875737795641856:12345-0@lo:502: Request processed in 3463us (3624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843069.232698:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788843069.232837:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795641856:0@lo:502: 00000040:00080000:2.0:1788843069.233000:0:7631:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1788843069.233017:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788843069.233868:0:7646:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788843069.233906:0:7646:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8dab77ac19b8) 00000020:00000080:0.0:1788843069.233930:0:7646:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788843069.234214:0:7646:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dab51a7d800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788843069.234218:0:7646:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dab51a7d800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788843069.234221:0:7646:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab51a7d800 3 00010000:00080000:0.0:1788843069.234252:0:7646:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dab77ab2000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.129@tcp at head 00010000:00010000:1.0:1788843069.245276:0:7646:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1788843069.246110:0:7646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1788843069.246154:0:7646:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788843069.246166:0:7646:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc6b8ac1b0914bdb 00000100:00080000:1.0:1788843069.246176:0:7646:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788843069.246181:0:7646:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dab77ab2000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1788843069.246213:0:7646:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab600be300 x1875737795641984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843069.246230:0:7646:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788843069.246410:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875737795641984:0@lo:38: 00000100:00100000:0.0:1788843069.246478:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843069.247766:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795641984 00000100:00100000:1.0:1788843069.247776:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795641984 00000100:00100000:1.0:1788843069.247814:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843069.247822:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875737795641984:12345-0@lo:38: 00010000:00080000:1.0:1788843069.247847:0:5848:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:1.0:1788843069.248557:0:5848:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc6b8ac1b0914be2 00000004:00100000:1.0:1788843069.248576:0:5848:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788843069.248613:0:5848:0:(import.c:65:import_set_state_nolock()) ffff8dab73d8c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843069.248839:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875737795641984:12345-0@lo:38: Request processed in 1015us (2359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843069.248848:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788843069.250804:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab600be300 x1875737795641984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843069.250821:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788843069.250833:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788843069.250843:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788843069.250850:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788843069.250853:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab77ab2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788843069.250861:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875737795641984:0@lo:38: 00000100:00100000:3.0:1788843069.251263:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795642368:0@lo:400: 00000100:00100000:3.0:1788843069.251326:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843069.251378:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843069.251386:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795642240:0@lo:400: 00000100:00100000:3.0:1788843069.251414:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843069.251448:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795642368 00000100:00100000:3.0:1788843069.251454:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795642368 00000100:00100000:3.0:1788843069.251511:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843069.251521:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795642368:12345-0@lo:400: 00000100:00100000:3.0:1788843069.251570:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcadf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795642368:12345-0@lo:400: Request processed in 51us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843069.251578:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843069.251605:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795642240 00000100:00100000:3.0:1788843069.251609:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795642240 00010000:00080000:2.0:1788843069.251613:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6ec48700 x1875737795642368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843069.251626:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec48700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795642368:0@lo:400: 00000100:00100000:1.0:1788843069.252393:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795642112:0@lo:400: 00000100:00100000:1.0:1788843069.252458:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843069.253188:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795642112 00000100:00100000:3.0:1788843069.253196:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795642112 00000100:00100000:3.0:1788843069.253238:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788843069.253250:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795642240:12345-0@lo:400: 00000100:00100000:3.0:1788843069.253325:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795642240:12345-0@lo:400: Request processed in 79us (1910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843069.253332:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788843069.253364:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788843069.253372:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795642112:12345-0@lo:400: 00000100:00100000:3.0:1788843069.253634:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795642112:12345-0@lo:400: Request processed in 263us (1174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843069.253718:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1788843069.253739:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843069.253745:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788843069.254172:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6ec4b480 x1875737795642112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843069.254187:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795642112:0@lo:400: 00010000:00080000:3.0:1788843069.254368:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6ec48380 x1875737795642240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843069.254378:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795642240:0@lo:400: 00000100:00100000:1.0:1788843069.256843:0:7647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bce00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7647:1875737795642496:0@lo:901: 00000100:00100000:1.0:1788843069.256930:0:7647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843069.257186:0:7647:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab5070d900 going to sleep for 11 seconds 00000040:00080000:1.0:1788843069.257318:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1788843069.257735:0:7631:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788843069.257763:0:7631:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788843069.257780:0:7631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41532400/0xc6b8ac1b0914bc6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914bcd expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843069.257791:0:7631:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab41532400/0xc6b8ac1b0914bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914bcd expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788843069.257847:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788843069.257849:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843069.257850:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843069.257851:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843069.257852:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843069.257854:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843069.257855:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843069.257856:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788843069.257858:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788843069.257859:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843069.257860:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788843069.257865:0:7631:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1788843069.257867:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788843069.257868:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843069.257869:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843069.257870:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843069.257872:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000100:00100000:3.0:1788843069.258182:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795642496 00000100:00100000:3.0:1788843069.258191:0:5857:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795642496 00000100:00100000:3.0:1788843069.258262:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788843069.258273:0:5857:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7647:x1875737795642496:12345-0@lo:901: 00000100:00100000:3.0:1788843069.258753:0:5857:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7647:x1875737795642496:12345-0@lo:901: Request processed in 479us (1820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843069.258762:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000004:2.0:1788843069.259012:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843069.259014:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843069.259015:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788843069.259017:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788843069.259018:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843069.259020:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788843069.259057:0:7631:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788843069.259073:0:7631:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795642624:0@lo:253: 00000100:00100000:2.0:1788843069.259126:0:7631:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843069.259167:0:7631:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7cd49c00 going to sleep for 11 seconds 00000100:00080000:1.0:1788843069.259188:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843069.259253:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795642624 00000100:00100000:0.0:1788843069.259260:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795642624 00000100:00100000:0.0:1788843069.259307:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788843069.259317:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+14:7631:x1875737795642624:12345-0@lo:253: 20000000:01000000:0.0:1788843069.259359:0:5839:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788843069.259374:0:5839:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788843069.259803:0:7647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab600bce00 x1875737795642496/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788843085 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843069.259819:0:7647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bce00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7647:1875737795642496:0@lo:901: 20000000:01000000:1.0:1788843069.293865:0:5839:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788843069.293892:0:5839:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788843069.294052:0:5862:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788843069.294057:0:5862:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788843069.294080:0:5862:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914be9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.294097:0:5862:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914b3a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914b33 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.294121:0:5862:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914be9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.294159:0:5862:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914b3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914b33 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.294172:0:5862:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914b3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b33 expref: 14 pid: 5840 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843069.294185:0:5862:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1875737795642752:0@lo:104: 00000100:00100000:3.0:1788843069.294251:0:5862:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843069.294305:0:5862:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46b77f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843069.294436:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795642752 00000100:00100000:1.0:1788843069.294444:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795642752 00000100:00100000:1.0:1788843069.294490:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788843069.294499:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+3:5862:x1875737795642752:12345-0@lo:104: 00010000:00010000:1.0:1788843069.294511:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab40030400/0xc6b8ac1b0914b33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914b3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843069.294563:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788843069.294570:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+3:5862:x1875737795642752:12345-0@lo:104: Request processed in 73us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843069.294577:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1788843069.294823:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843069.294829:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab40030400/0xc6b8ac1b0914b33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914b3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.294837:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40030400 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843069.294841:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab40030400/0xc6b8ac1b0914b33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914b3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.294849:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab40030400/0xc6b8ac1b0914b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914b3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843069.294856:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab40030400/0xc6b8ac1b0914b33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914b3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843069.294861:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788843069.294903:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab40030400/0xc6b8ac1b0914b33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914b3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.294922:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843069.294941:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab40030400/0xc6b8ac1b0914b33 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914b3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.294947:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab40030400/0xc6b8ac1b0914b33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914b3a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.294973:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843069.294975:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843069.294976:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843069.294998:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795642880:0@lo:103: 00000100:00100000:3.0:1788843069.295032:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843069.295078:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795642880 00000100:00100000:3.0:1788843069.295083:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795642880 00010000:00010000:3.0:1788843069.295100:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914b3a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b33 expref: 15 pid: 5840 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843069.295122:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788843069.295128:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51553850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28cf63da-daee-485f-b466-4ec68876f732+15:3304:x1875737795642880:12345-0@lo:103: 00010000:00010000:3.0:1788843069.295137:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843069.295142:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914b3a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b33 expref: 15 pid: 5840 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.295151:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914b3a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b33 expref: 15 pid: 5840 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.295167:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914be9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.295185:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914be9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788843069.295198:0:6708:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001141334s 00010000:00010000:3.0:1788843069.295202:0:6708:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914be9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.295209:0:6708:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914be9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.295216:0:6708:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914be9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.295222:0:6708:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914be9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.295227:0:6708:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41533200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843069.295231:0:6708:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914be9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.295238:0:6708:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914be9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.295246:0:6708:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914be9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.295255:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843069.295285:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51553850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28cf63da-daee-485f-b466-4ec68876f732+15:3304:x1875737795642880:12345-0@lo:103: Request processed in 157us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843069.295293:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788843069.295555:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795642880:0@lo:103: 00010000:00010000:3.0:1788843069.295598:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914b3a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914b33 expref: 14 pid: 5840 timeout: 343 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843069.295609:0:5862:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5862:1875737795642752:0@lo:104: 00010000:00010000:3.0:1788843069.295619:0:5862:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914be9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.295626:0:5862:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914be9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.295632:0:5862:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914be9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843069.295638:0:5862:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914be9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5862 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843069.305632:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+13:7631:x1875737795642624:12345-0@lo:253: Request processed in 46308us (46496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843069.305646:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788843069.305795:0:7631:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec48700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:28cf63da-daee-485f-b466-4ec68876f732:7631:1875737795642624:0@lo:253: 10000000:01000000:2.0:1788843069.305811:0:7631:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788843069.305814:0:7631:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788843069.305816:0:7631:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843069.305817:0:7631:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843069.305818:0:7631:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843069.305819:0:7631:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843069.305821:0:7631:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843069.305822:0:7631:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843069.305824:0:7631:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788843069.305825:0:7631:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788843069.305827:0:7631:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843069.305828:0:7631:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788843069.305843:0:7631:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788843069.312116:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788843069.312333:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788843069.312807:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788843069.313097:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788843069.313315:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788843069.313842:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788843069.315048:0:7631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1788843069.542907:0:7631:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788843069.542916:0:7631:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788843069.542951:0:7631:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788843069.543027:0:7631:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788843069.543041:0:7631:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788843069.543074:0:7631:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788843070.213472:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843071.236494:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843071.812872:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843071.822775:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795643008:0@lo:13: 00000100:00100000:1.0:1788843071.822842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843071.822954:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795643008 00000100:00100000:3.0:1788843071.822962:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795643008 00000100:00100000:3.0:1788843071.823034:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843071.823044:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795643008:12345-0@lo:13: 00002000:00000024:3.0:1788843071.823077:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788843071.823138:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795643008:12345-0@lo:13: Request processed in 95us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843071.823144:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788843071.823179:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7fc78000 x1875737795643008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843087 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843071.823196:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795643008:0@lo:13: 00000100:00080000:1.0:1788843071.823359:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788843072.260515:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843073.286623:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843074.309930:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843074.376521:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795643392:0@lo:400: 00000100:00100000:1.0:1788843074.376589:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843074.376651:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843074.376658:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795643520:0@lo:400: 00000100:00100000:1.0:1788843074.376684:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843074.376724:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795643392 00000100:00100000:1.0:1788843074.376731:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795643392 00000100:00100000:1.0:1788843074.376789:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788843074.376800:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795643392:12345-0@lo:400: 00000100:00100000:1.0:1788843074.376852:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795643392:12345-0@lo:400: Request processed in 55us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843074.376858:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788843074.376886:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795643520 00000100:00100000:1.0:1788843074.376890:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795643520 00000100:00100000:1.0:1788843074.376917:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843074.376923:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795643520:12345-0@lo:400: 00000100:00100000:1.0:1788843074.376966:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795643520:12345-0@lo:400: Request processed in 43us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843074.376971:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788843074.376992:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788843074.376996:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788843074.377026:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab600bea00 x1875737795643520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843074.377040:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795643520:0@lo:400: 00010000:00080000:1.0:1788843074.377050:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab600bd500 x1875737795643392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843074.377058:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795643392:0@lo:400: 00000100:00100000:3.0:1788843074.377224:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795643264:0@lo:400: 00000100:00100000:3.0:1788843074.377255:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843074.377284:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788843074.377291:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795643136:0@lo:400: 00000100:00100000:3.0:1788843074.377318:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843074.377365:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795643648:0@lo:400: 00000100:00100000:3.0:1788843074.377388:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843074.377420:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795643136 00000100:00100000:3.0:1788843074.377424:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795643136 00000100:00100000:3.0:1788843074.377447:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788843074.377453:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+13:3307:x1875737795643136:12345-0@lo:400: 00000100:00100000:3.0:1788843074.377484:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+13:3307:x1875737795643136:12345-0@lo:400: Request processed in 31us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843074.377491:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788843074.377520:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795643136:0@lo:400: 00000100:00100000:1.0:1788843074.379135:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795643264 00000100:00100000:1.0:1788843074.379147:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795643264 00000100:00100000:1.0:1788843074.379203:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795643648 00000100:00100000:1.0:1788843074.379207:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795643648 00000100:00100000:3.0:1788843074.379422:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788843074.379435:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795643264:12345-0@lo:400: 00000100:00100000:3.0:1788843074.379511:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795643264:12345-0@lo:400: Request processed in 79us (2254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843074.379538:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788843074.379582:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab600bca80 x1875737795643264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843074.379595:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795643264:0@lo:400: 00000100:00100000:1.0:1788843074.380128:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788843074.380138:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795643648:12345-0@lo:400: 00000100:00100000:1.0:1788843074.380192:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795643648:12345-0@lo:400: Request processed in 57us (2803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843074.380197:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788843074.380237:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab600be680 x1875737795643648/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843074.380247:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795643648:0@lo:400: 00000100:00080000:2.0:1788843074.381148:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788843075.332705:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788843075.484157:0:7990:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788843076.356713:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843076.932584:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843076.932615:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795643776:0@lo:13: 00000100:00100000:2.0:1788843076.932701:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843076.932795:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795643776 00000100:00100000:2.0:1788843076.932806:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795643776 00000100:00100000:2.0:1788843076.932868:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788843076.932880:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795643776:12345-0@lo:13: 00002000:00000024:2.0:1788843076.932915:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788843076.932978:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795643776:12345-0@lo:13: Request processed in 100us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843076.932996:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788843076.933019:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788843076.933052:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7bcafb80 x1875737795643776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843092 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843076.933072:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795643776:0@lo:13: 00010000:00010000:3.0:1788843077.387386:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788843077.958256:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788843077.958267:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dab7395d800 from 30 10000000:01000000:1.0:1788843077.958273:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788843077.958329:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933bc00/0xc6b8ac1b0914bf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843077.958358:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab4933bc00/0xc6b8ac1b0914bf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843077.958370:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab4933bc00/0xc6b8ac1b0914bf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843077.958394:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795643904:0@lo:101: 00000100:00100000:1.0:1788843077.958482:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843077.958554:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4939ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788843077.958638:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795643904 00000100:00100000:0.0:1788843077.958646:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795643904 00000100:00100000:0.0:1788843077.958700:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788843077.958710:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+13:5844:x1875737795643904:12345-0@lo:101: 00010000:00010000:0.0:1788843077.958723:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843077.958737:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab40030400/0xc6b8ac1b0914bf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914bf0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843077.958762:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab40030400/0xc6b8ac1b0914bf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914bf0 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843077.958772:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab40030400/0xc6b8ac1b0914bf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914bf0 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843077.958780:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab40030400, rc 0) 00000100:00100000:0.0:1788843077.958830:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+14:5844:x1875737795643904:12345-0@lo:101: Request processed in 121us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843077.958837:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788843077.959138:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795643904:0@lo:101: 00010000:00010000:1.0:1788843077.959153:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab4933bc00/0xc6b8ac1b0914bf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914bf7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843077.959162:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab4933bc00/0xc6b8ac1b0914bf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914bf7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843077.959222:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795644032:0@lo:501: 00000100:00100000:1.0:1788843077.959251:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843077.959272:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4939ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843077.960094:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795644032 00000100:00100000:3.0:1788843077.960104:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795644032 00000100:00100000:3.0:1788843077.960162:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788843077.960170:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+14:5844:x1875737795644032:12345-0@lo:501: 00000100:00100000:3.0:1788843077.960656:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+14:5844:x1875737795644032:12345-0@lo:501: Request processed in 486us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843077.960664:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788843077.962919:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795644032:0@lo:501: 00000100:00100000:1.0:1788843077.963013:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795644160:0@lo:503: 00000100:00100000:1.0:1788843077.963105:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843077.963155:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4939ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788843077.963311:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795644160 00000100:00100000:0.0:1788843077.963320:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795644160 00000100:00100000:0.0:1788843077.963420:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788843077.963430:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+14:5844:x1875737795644160:12345-0@lo:503: 00000100:00100000:0.0:1788843077.964149:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+14:5844:x1875737795644160:12345-0@lo:503: Request processed in 717us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843077.964171:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788843077.966085:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795644160:0@lo:503: 00000100:00100000:3.0:1788843077.967266:0:8094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8094:1875737795644288:0@lo:502: 00000100:00100000:3.0:1788843077.967387:0:8094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843077.967438:0:8094:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41aebf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843077.967526:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795644288 00000100:00100000:2.0:1788843077.967534:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795644288 00000100:00100000:2.0:1788843077.967599:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788843077.967609:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+14:8094:x1875737795644288:12345-0@lo:502: 00000100:00100000:2.0:1788843077.968181:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+14:8094:x1875737795644288:12345-0@lo:502: Request processed in 573us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843077.968189:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788843077.968387:0:8094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8094:1875737795644288:0@lo:502: 00000100:00100000:3.0:1788843077.968450:0:8094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8094:1875737795644416:0@lo:502: 00000100:00100000:3.0:1788843077.968490:0:8094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843077.968529:0:8094:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41aebf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843077.968599:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795644416 00000100:00100000:1.0:1788843077.968605:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795644416 00000100:00100000:1.0:1788843077.968639:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788843077.968647:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+14:8094:x1875737795644416:12345-0@lo:502: 00000100:00100000:1.0:1788843077.969041:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+14:8094:x1875737795644416:12345-0@lo:502: Request processed in 392us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843077.969048:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788843077.969200:0:8094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8094:1875737795644416:0@lo:502: 00000040:00080000:3.0:1788843077.969224:0:8094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788843077.969501:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788843077.969523:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788843077.969544:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933bc00/0xc6b8ac1b0914bf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914bf7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843077.969556:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933bc00/0xc6b8ac1b0914bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914bf7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843077.969576:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788843077.969580:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788843077.969584:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788843077.969614:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0914bfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843077.969621:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0914bfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843077.969631:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0914bfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843077.969647:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795644544:0@lo:101: 00000100:00100000:1.0:1788843077.969964:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843077.970004:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4939aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843077.970085:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795644544 00000100:00100000:2.0:1788843077.970092:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795644544 00000100:00100000:2.0:1788843077.970139:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788843077.970147:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+14:5844:x1875737795644544:12345-0@lo:101: 00010000:00010000:2.0:1788843077.970159:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843077.970173:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab821c4e00/0xc6b8ac1b0914c05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914bfe expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843077.970196:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c4e00/0xc6b8ac1b0914c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914bfe expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843077.970206:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab821c4e00/0xc6b8ac1b0914c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914bfe expref: 15 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843077.970216:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4e00, rc 0) 00000100:00100000:2.0:1788843077.970274:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+15:5844:x1875737795644544:12345-0@lo:101: Request processed in 128us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843077.970280:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788843077.971244:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795644544:0@lo:101: 00010000:00010000:1.0:1788843077.971264:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0914bfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914c05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843077.971275:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0914bfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914c05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843077.971376:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795644672:0@lo:501: 00000100:00100000:1.0:1788843077.971420:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843077.971454:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4939aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843077.971544:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795644672 00000100:00100000:2.0:1788843077.971550:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795644672 00000100:00100000:2.0:1788843077.971587:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788843077.971596:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+15:5844:x1875737795644672:12345-0@lo:501: 00000100:00100000:2.0:1788843077.972273:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+15:5844:x1875737795644672:12345-0@lo:501: Request processed in 676us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843077.972282:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788843077.972508:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795644672:0@lo:501: 00000100:00100000:1.0:1788843077.972548:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795644800:0@lo:503: 00000100:00100000:1.0:1788843077.972606:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843077.972717:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4939aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788843077.983099:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795644800 00000100:00100000:3.0:1788843077.983119:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795644800 00000100:00100000:3.0:1788843077.983274:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788843077.983288:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+15:5844:x1875737795644800:12345-0@lo:503: 00000100:00100000:3.0:1788843077.985142:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+15:5844:x1875737795644800:12345-0@lo:503: Request processed in 1850us (12527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843077.985155:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788843077.985393:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795644800:0@lo:503: 00000100:00100000:1.0:1788843077.985867:0:8095:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8095:1875737795644928:0@lo:502: 00000100:00100000:1.0:1788843077.985913:0:8095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843077.985956:0:8095:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4939a300 going to sleep for 11 seconds 00000100:00100000:0.0:1788843077.986044:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795644928 00000100:00100000:0.0:1788843077.986050:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795644928 00000100:00100000:0.0:1788843077.986084:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788843077.986092:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+15:8095:x1875737795644928:12345-0@lo:502: 00000100:00100000:0.0:1788843077.986327:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+15:8095:x1875737795644928:12345-0@lo:502: Request processed in 235us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843077.986334:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788843077.986680:0:8095:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8095:1875737795644928:0@lo:502: 00000020:01000000:1.0:1788843077.986704:0:8095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843077.986712:0:8095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843077.986714:0:8095:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788843077.986720:0:8095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788843077.986722:0:8095:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788843077.986736:0:8095:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8095:1875737795645056:0@lo:502: 00000100:00100000:1.0:1788843077.986767:0:8095:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843077.986802:0:8095:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4939a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788843077.987010:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795645056 00000100:00100000:3.0:1788843077.987016:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795645056 00000100:00100000:3.0:1788843077.987040:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788843077.987047:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+15:8095:x1875737795645056:12345-0@lo:502: 00000100:00100000:3.0:1788843077.989451:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+15:8095:x1875737795645056:12345-0@lo:502: Request processed in 2393us (2672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843077.989469:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788843077.991790:0:8095:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8095:1875737795645056:0@lo:502: 00000020:01000000:1.0:1788843077.991847:0:8095:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843077.991859:0:8095:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843077.991861:0:8095:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788843077.991867:0:8095:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788843077.992490:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788843077.992518:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788843077.992530:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0914bfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914c05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843077.992543:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0914bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914c05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843077.992555:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788843077.992557:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dab71a20000 from 30 10000000:01000000:2.0:1788843077.992560:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788843077.992598:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0914c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843077.992606:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0914c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843077.992615:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0914c0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843077.992650:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795645184:0@lo:101: 00000100:00100000:2.0:1788843077.992740:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843077.992802:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4a886180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843077.992868:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795645184 00000100:00100000:3.0:1788843077.992875:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795645184 00000100:00100000:3.0:1788843077.992924:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788843077.992945:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+15:5844:x1875737795645184:12345-0@lo:101: 00010000:00010000:3.0:1788843077.992958:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843077.992972:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914c13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914c0c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843077.993008:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914c0c expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843077.993019:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914c0c expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843077.993029:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41532a00, rc 0) 00000100:00100000:3.0:1788843077.993079:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+16:5844:x1875737795645184:12345-0@lo:101: Request processed in 135us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843077.993086:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788843077.994076:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795645184:0@lo:101: 00010000:00010000:2.0:1788843077.994100:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0914c0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914c13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843077.994112:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0914c0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914c13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843077.994198:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795645312:0@lo:501: 00000100:00100000:2.0:1788843077.994245:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843077.994290:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4a886180 going to sleep for 11 seconds 00000100:00100000:0.0:1788843077.994463:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795645312 00000100:00100000:0.0:1788843077.994470:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795645312 00000100:00100000:0.0:1788843077.994520:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788843077.994538:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+16:5844:x1875737795645312:12345-0@lo:501: 00000100:00100000:0.0:1788843077.994832:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+16:5844:x1875737795645312:12345-0@lo:501: Request processed in 304us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843077.994850:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788843077.995017:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795645312:0@lo:501: 00000100:00100000:2.0:1788843077.995053:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795645440:0@lo:503: 00000100:00100000:2.0:1788843077.995096:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843077.995128:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4a886180 going to sleep for 11 seconds 00000100:00100000:0.0:1788843077.995584:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795645440 00000100:00100000:0.0:1788843077.995591:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795645440 00000100:00100000:0.0:1788843077.995634:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788843077.995643:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+16:5844:x1875737795645440:12345-0@lo:503: 00000100:00100000:0.0:1788843077.995833:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+16:5844:x1875737795645440:12345-0@lo:503: Request processed in 190us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843077.995855:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788843077.996026:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795645440:0@lo:503: 00000100:00100000:0.0:1788843077.997455:0:8096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8096:1875737795645568:0@lo:502: 00000100:00100000:0.0:1788843077.997536:0:8096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843077.997572:0:8096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab603b7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843077.997637:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795645568 00000100:00100000:2.0:1788843077.997645:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795645568 00000100:00100000:2.0:1788843077.997691:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788843077.997702:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+16:8096:x1875737795645568:12345-0@lo:502: 00000100:00100000:2.0:1788843077.997972:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+16:8096:x1875737795645568:12345-0@lo:502: Request processed in 272us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843077.997989:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788843077.998401:0:8096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8096:1875737795645568:0@lo:502: 00000100:00100000:0.0:1788843077.998461:0:8096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8096:1875737795645696:0@lo:502: 00000100:00100000:0.0:1788843077.998506:0:8096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843077.998532:0:8096:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab61fd1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843077.998878:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795645696 00000100:00100000:1.0:1788843077.998885:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795645696 00000100:00100000:1.0:1788843077.998939:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788843077.998948:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+16:8096:x1875737795645696:12345-0@lo:502: 00000100:00100000:1.0:1788843077.999193:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+16:8096:x1875737795645696:12345-0@lo:502: Request processed in 245us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843077.999200:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788843077.999548:0:8096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc7bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8096:1875737795645696:0@lo:502: 00000040:00080000:0.0:1788843077.999574:0:8096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788843078.000970:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788843078.001008:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788843078.001024:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0914c0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914c13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843078.001036:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0914c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914c13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843078.001048:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788843078.001051:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dab71a20000 from 5 10000000:01000000:2.0:1788843078.001055:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788843078.001096:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0914c1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843078.001105:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0914c1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843078.001116:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0914c1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843078.001141:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795645824:0@lo:101: 00000100:00100000:2.0:1788843078.001222:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843078.001267:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4a8866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843078.001708:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795645824 00000100:00100000:0.0:1788843078.001719:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795645824 00000100:00100000:0.0:1788843078.001777:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788843078.001790:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+16:5844:x1875737795645824:12345-0@lo:101: 00010000:00010000:0.0:1788843078.001804:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843078.001820:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab40030800/0xc6b8ac1b0914c21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914c1a expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843078.001922:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab40030800/0xc6b8ac1b0914c21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914c1a expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843078.001943:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab40030800/0xc6b8ac1b0914c21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914c1a expref: 17 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843078.001952:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab40030800, rc 0) 00000100:00100000:0.0:1788843078.001998:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795645824:12345-0@lo:101: Request processed in 210us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843078.002005:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788843078.002247:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795645824:0@lo:101: 00010000:00010000:2.0:1788843078.002266:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0914c1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914c21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843078.002275:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0914c1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914c21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843078.002373:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795645952:0@lo:256: 00000100:00100000:2.0:1788843078.002411:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843078.002446:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4a8866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843078.004525:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795645952 00000100:00100000:0.0:1788843078.004544:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795645952 00000100:00100000:0.0:1788843078.004615:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788843078.004625:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795645952:12345-0@lo:256: 20000000:01000000:0.0:1788843078.004649:0:5839:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788843078.004675:0:5839:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788843078.004678:0:5839:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788843078.004801:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795645952:12345-0@lo:256: Request processed in 177us (2389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843078.004809:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788843078.005208:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795645952:0@lo:256: 10000000:01000000:2.0:1788843078.005277:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788843078.005289:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0914c1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914c21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843078.005301:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0914c1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914c21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843078.005312:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788843078.005315:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788843078.005318:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788843078.005395:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914c28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843078.005404:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914c28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843078.005413:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914c28 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843078.005431:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795646080:0@lo:101: 00000100:00100000:2.0:1788843078.005474:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843078.005515:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51b153c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843078.006593:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795646080 00000100:00100000:0.0:1788843078.006605:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795646080 00000100:00100000:0.0:1788843078.006659:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788843078.006668:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795646080:12345-0@lo:101: 00010000:00010000:0.0:1788843078.006682:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843078.006699:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914c2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914c28 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843078.006730:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914c28 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843078.006742:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914c28 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843078.006750:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab40031a00, rc 0) 00000100:00100000:0.0:1788843078.006819:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795646080:12345-0@lo:101: Request processed in 151us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843078.006825:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788843078.007069:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795646080:0@lo:101: 00010000:00010000:2.0:1788843078.007098:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914c28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914c2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843078.007109:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914c28 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914c2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843078.007486:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795646208:0@lo:501: 00000100:00100000:2.0:1788843078.007530:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843078.007560:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51b153c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843078.007613:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795646208 00000100:00100000:3.0:1788843078.007618:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795646208 00000100:00100000:3.0:1788843078.007652:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788843078.007660:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795646208:12345-0@lo:501: 00000100:00100000:3.0:1788843078.007963:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795646208:12345-0@lo:501: Request processed in 303us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843078.007970:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788843078.009087:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795646208:0@lo:501: 00000100:00100000:2.0:1788843078.009148:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795646336:0@lo:503: 00000100:00100000:2.0:1788843078.009428:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843078.009573:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51b153c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843078.011868:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795646336 00000100:00100000:3.0:1788843078.011885:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795646336 00000100:00100000:2.0:1788843078.012226:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788843078.012240:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795646336:12345-0@lo:503: 00000100:00100000:2.0:1788843078.012716:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795646336:12345-0@lo:503: Request processed in 476us (3284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843078.012726:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788843078.012772:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec48380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795646336:0@lo:503: 00000100:00100000:3.0:1788843078.014286:0:8097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8097:1875737795646464:0@lo:502: 00000100:00100000:3.0:1788843078.014415:0:8097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843078.014456:0:8097:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41aebcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843078.016394:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795646464 00000100:00100000:1.0:1788843078.016409:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795646464 00000100:00100000:1.0:1788843078.016482:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788843078.016495:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+18:8097:x1875737795646464:12345-0@lo:502: 00000100:00100000:1.0:1788843078.016889:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+18:8097:x1875737795646464:12345-0@lo:502: Request processed in 396us (2474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843078.016905:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788843078.018101:0:8097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8097:1875737795646464:0@lo:502: 00000020:01000000:3.0:1788843078.018148:0:8097:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788843078.018155:0:8097:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788843078.018162:0:8097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843078.018164:0:8097:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788843078.018167:0:8097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788843078.018170:0:8097:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:3.0:1788843078.018193:0:8097:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788843078.018196:0:8097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788843078.018213:0:8097:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8dab477dcd28) 00000020:00000080:3.0:1788843078.018237:0:8097:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788843078.018241:0:8097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788843078.018335:0:8097:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788843078.018360:0:8097:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788843078.018368:0:8097:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b0914c3d 00010000:00080000:3.0:1788843078.018405:0:8097:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dab7c189000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1788843078.018808:0:8097:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1788843078.019105:0:8097:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788843078.019115:0:8097:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788843078.019710:0:8097:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843078.019945:0:8097:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843078.020003:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1788843078.020066:0:8097:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1788843078.020648:0:8098:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788843078.020653:0:8098:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788843078.021491:0:8097:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788843078.021503:0:8097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788843078.021605:0:8097:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788843078.021628:0:8097:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b8ac1b0914c44 00000100:00080000:1.0:1788843078.021639:0:8097:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788843078.021646:0:8097:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dab7c189000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1788843078.021693:0:8097:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab600be680 x1875737795646592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843078.021718:0:8097:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788843078.021796:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795646592:0@lo:8: 00000020:01000000:1.0:1788843078.021810:0:8097:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843078.021816:0:8097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843078.021819:0:8097:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788843078.021821:0:8097:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843078.021826:0:8097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843078.021827:0:8097:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788843078.021831:0:8097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788843078.021833:0:8097:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788843078.021858:0:8097:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8097:1875737795646720:0@lo:502: 00000100:00100000:0.0:1788843078.021901:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843078.021953:0:8097:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843078.021983:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795646720 00000100:00100000:1.0:1788843078.021990:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795646720 00000100:00100000:1.0:1788843078.022031:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788843078.022040:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:8097:x1875737795646720:12345-0@lo:502: 00000100:00100000:1.0:1788843078.022268:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:8097:x1875737795646720:12345-0@lo:502: Request processed in 228us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843078.022276:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788843078.022315:0:8097:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4939af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843078.022334:0:8097:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8097:1875737795646720:0@lo:502: 00000020:01000000:1.0:1788843078.022374:0:8097:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843078.022377:0:8097:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843078.022379:0:8097:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788843078.022382:0:8097:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788843078.022464:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788843078.022487:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788843078.022497:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914c28 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914c2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843078.022519:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914c28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914c2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843078.022528:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788843078.022531:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dab600719b8 from 1 10000000:01000000:0.0:1788843078.022534:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788843078.022558:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914c4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843078.022567:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914c4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843078.022575:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795646592 00010000:00010000:0.0:1788843078.022576:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914c4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843078.022581:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795646592 00000100:00100000:0.0:1788843078.022593:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795646848:0@lo:101: 00000100:00100000:3.0:1788843078.022615:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843078.022622:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1875737795646592:12345-0@lo:8: 00000100:00100000:0.0:1788843078.022630:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788843078.022649:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 202 last 0 00000100:00100000:0.0:1788843078.022654:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab61fd1300 going to sleep for 11 seconds 00000100:00100000:0.0:1788843078.022672:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795646848 00000100:00100000:0.0:1788843078.022676:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795646848 00000020:00000080:3.0:1788843078.022679:0:6693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b8ac1b0914c52 00002000:00100000:3.0:1788843078.022695:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8dab7c18e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113970 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788843078.022699:0:6693:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:0.0:1788843078.022707:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000001:00000004:3.0:1788843078.022708:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1788843078.022716:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795646848:12345-0@lo:101: 00010000:00010000:0.0:1788843078.022726:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843078.022741:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab40030a00/0xc6b8ac1b0914c59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914c4b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843078.022763:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab40030a00/0xc6b8ac1b0914c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914c4b expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843078.022786:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab40030a00/0xc6b8ac1b0914c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914c4b expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843078.022796:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab40030a00, rc 0) 00000100:00100000:2.0:1788843078.022820:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795646976:0@lo:400: 00002000:00100000:3.0:1788843078.022826:0:6693:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1788843078.022861:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795646848:12345-0@lo:101: Request processed in 145us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843078.022862:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843078.022874:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788843078.022904:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843078.022919:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795647104:0@lo:400: 00000100:00100000:0.0:1788843078.022921:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795646848:0@lo:101: 00010000:00010000:0.0:1788843078.022950:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914c4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914c59 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843078.022960:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788843078.022964:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914c4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914c59 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843078.022994:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795647232:0@lo:400: 00000100:00100000:2.0:1788843078.023024:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1788843078.023030:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:0.0:1788843078.023041:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795647488:0@lo:501: 00000100:00100000:2.0:1788843078.023046:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843078.023053:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795647360:0@lo:400: 00000100:00080000:3.0:1788843078.023055:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8dab7c18f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843078.023077:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843078.023088:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843078.023102:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab61fd1300 going to sleep for 11 seconds 00010000:00080000:0.0:1788843078.023131:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab600be680 x1875737795646592/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788843088 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843078.023142:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788843078.023149:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00100000:3.0:1788843078.023232:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1875737795646592:12345-0@lo:8: Request processed in 609us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843078.023239:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788843078.023246:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795646976 00000100:00100000:2.0:1788843078.023249:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795646976 00000100:00100000:3.0:1788843078.023251:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795647232 00000100:00100000:3.0:1788843078.023253:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795647232 00000100:00100000:3.0:1788843078.023278:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788843078.023282:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795647104 00000100:00100000:3.0:1788843078.023284:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795647232:12345-0@lo:400: 00000100:00100000:2.0:1788843078.023284:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795647104 00000100:00100000:2.0:1788843078.023298:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795647360 00000100:00100000:2.0:1788843078.023301:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795647360 00000100:00080000:0.0:1788843078.023305:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788843078.023314:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00100000:2.0:1788843078.023318:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788843078.023318:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab7c189000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788843078.023323:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795647232:12345-0@lo:400: Request processed in 38us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843078.023328:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795646976:12345-0@lo:400: 00000100:00100000:3.0:1788843078.023331:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000004:00080000:0.0:1788843078.023336:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788843078.023370:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795646592:0@lo:8: 00000100:00100000:2.0:1788843078.023389:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795646976:12345-0@lo:400: Request processed in 61us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843078.023395:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788843078.023404:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795647488 00000100:00100000:0.0:1788843078.023410:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795647488 00000100:00100000:2.0:1788843078.023415:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788843078.023422:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795647104:12345-0@lo:400: 00000100:00100000:0.0:1788843078.023442:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788843078.023450:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795647488:12345-0@lo:501: 00000100:00100000:0.0:1788843078.023675:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795647488:12345-0@lo:501: Request processed in 225us (598us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843078.023681:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795647104:12345-0@lo:400: Request processed in 256us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843078.023687:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788843078.023696:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788843078.023711:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843078.023718:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795647360:12345-0@lo:400: 00000100:00100000:3.0:1788843078.023725:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc79180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795647488:0@lo:501: 00000100:00100000:2.0:1788843078.023751:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795647360:12345-0@lo:400: Request processed in 35us (665us total) trans 0 rc 0/0 10000000:01000000:3.0:1788843078.023757:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00000100:00100000:2.0:1788843078.023764:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1788843078.023766:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914c4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914c59 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843078.023776:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914c4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914c59 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788843078.023794:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843078.023798:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788843078.023812:0:8098:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788843078.023904:0:8098:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 202274562158ns, next at 0ns, rc = 0 00010000:00080000:2.0:1788843078.024061:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6ec4a300 x1875737795647104/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843078.024073:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795647104:0@lo:400: 00010000:00080000:2.0:1788843078.024086:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6ec4b480 x1875737795646976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843078.024095:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795646976:0@lo:400: 00010000:00080000:2.0:1788843078.024124:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6ec49180 x1875737795647360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843078.024132:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec49180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795647360:0@lo:400: 00010000:00080000:2.0:1788843078.024146:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6ec4b800 x1875737795647232/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843094 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843078.024154:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795647232:0@lo:400: 00000004:00080000:3.0:1788843078.094314:0:8099:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788843078.094435:0:8099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8099:1875737795647744:0@lo:7: 00000100:00100000:3.0:1788843078.094541:0:8099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843078.094584:0:8099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41aeb840 going to sleep for 11 seconds 00000100:00100000:3.0:1788843078.094603:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795647744 00000100:00100000:3.0:1788843078.094609:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795647744 00000100:00100000:3.0:1788843078.094663:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843078.094672:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8099:x1875737795647744:12345-0@lo:7: 00000004:00080000:2.0:1788843078.095032:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:2.0:1788843078.095077:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795647616:0@lo:13: 00000100:00100000:2.0:1788843078.095118:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788843078.095168:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843078.095207:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795647616 00000100:00100000:2.0:1788843078.095211:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795647616 00000100:00100000:2.0:1788843078.095242:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843078.095248:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875737795647616:12345-0@lo:13: 00002000:00000024:2.0:1788843078.095280:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788843078.095330:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875737795647616:12345-0@lo:13: Request processed in 81us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843078.095437:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788843078.095571:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7bcac000 x1875737795647616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843078.095590:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795647616:0@lo:13: 00002000:00080000:1.0:1788843078.106476:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788843078.106487:0:6693:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788843078.106599:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8099:x1875737795647744:12345-0@lo:7: Request processed in 11923us (12054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843078.106610:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788843078.107509:0:8099:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7bcad180 x1875737795647744/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788843094 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843078.107528:0:8099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8099:1875737795647744:0@lo:7: 00000004:00080000:3.0:1788843078.107547:0:8099:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788843078.107592:0:8099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8099:1875737795647872:0@lo:5: 00000100:00100000:3.0:1788843078.107639:0:8099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843078.107700:0:8099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41aeb840 going to sleep for 11 seconds 00000100:00100000:1.0:1788843078.109238:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795647872 00000100:00100000:1.0:1788843078.109253:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795647872 00000100:00100000:1.0:1788843078.110362:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788843078.110379:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8099:x1875737795647872:12345-0@lo:5: 00002000:00080000:1.0:1788843078.110417:0:6692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788843078.110422:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788843078.110837:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8099:x1875737795647872:12345-0@lo:5: Request processed in 463us (3197us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788843078.110845:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788843078.110958:0:8099:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7bcad180 x1875737795647872/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843094 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843078.110977:0:8099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcad180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8099:1875737795647872:0@lo:5: 00000004:00080000:0.0:1788843078.110991:0:8099:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788843078.111036:0:8099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc79f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8099:1875737795648000:0@lo:700: 00000100:00100000:0.0:1788843078.111076:0:8099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843078.111126:0:8099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab44fe8540 going to sleep for 11 seconds 00000100:00100000:3.0:1788843078.114034:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795648000 00000100:00100000:3.0:1788843078.114050:0:6701:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795648000 00000100:00100000:3.0:1788843078.114110:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843078.114121:0:6701:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8099:x1875737795648000:12345-0@lo:700: 00000100:00100000:3.0:1788843078.114201:0:6701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6701:1875737795648128:0@lo:700: 00000100:00100000:3.0:1788843078.114270:0:6701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843078.114310:0:6701:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41aeb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843078.114328:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795648128 00000100:00100000:3.0:1788843078.114331:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795648128 00000100:00100000:3.0:1788843078.114390:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843078.114397:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6701:x1875737795648128:12345-0@lo:700: 40000000:02000000:3.0:1788843078.182177:0:5853:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788843078.192212:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6701:x1875737795648128:12345-0@lo:700: Request processed in 77810us (77936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843078.192225:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788843078.192289:0:6701:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7bcafb80 x1875737795648128/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788843094 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843078.192311:0:6701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcafb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6701:1875737795648128:0@lo:700: 40000000:02000000:3.0:1788843078.192328:0:6701:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1788843078.291551:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1788843078.291568:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788843078.291762:0:6701:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8099:x1875737795648000:12345-0@lo:700: Request processed in 177639us (180681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843078.291779:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788843078.295086:0:8099:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7fc79f80 x1875737795648000/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788843094 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843078.295104:0:8099:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788843078.295127:0:8099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc79f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8099:1875737795648000:0@lo:700: 00010000:00010000:1.0:1788843078.404805:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:1.0:1788843078.408393:0:8099:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788843078.411964:0:8099:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8099:1875737795648256:0@lo:5: 00000100:00100000:1.0:1788843078.412044:0:8099:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843078.412166:0:8099:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4939a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788843078.412212:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795648256 00000100:00100000:3.0:1788843078.412219:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795648256 00000100:00100000:3.0:1788843078.412323:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788843078.412363:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8099:x1875737795648256:12345-0@lo:5: 00002000:00080000:2.0:1788843078.420569:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1788843078.420591:0:6693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1788843078.424872:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8099:x1875737795648256:12345-0@lo:5: Request processed in 12532us (12820us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788843078.424891:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788843078.425542:0:8099:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab600bd500 x1875737795648256/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788843094 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843078.425561:0:8099:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8099:1875737795648256:0@lo:5: 00000004:00080000:1.0:1788843078.425576:0:8099:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1788843079.428509:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788843079.911950:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1788843080.345562:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843080.345936:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775702144 00000100:00100000:0.0:1788843080.345949:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775702144 00000100:00100000:0.0:1788843080.345993:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 111 00000100:00100000:0.0:1788843080.346004:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2355:x1875737775702144:12345-192.168.203.29@tcp:250: 00010000:00080000:0.0:1788843080.346040:0:5840:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48@192.168.203.29@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:0.0:1788843080.346073:0:5840:0:(genops.c:1385:class_connect()) connect: client 09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48, cookie 0xc6b8ac1b0914c60 00000100:00080000:0.0:1788843080.346237:0:5840:0:(import.c:65:import_set_state_nolock()) ffff8dab77ab1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843080.346314:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+5:2355:x1875737775702144:12345-192.168.203.29@tcp:250: Request processed in 310us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843080.346371:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 111 00000100:00100000:3.0:1788843080.376959:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843080.377177:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775702272 00000100:00100000:2.0:1788843080.377188:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775702272 00000100:00100000:2.0:1788843080.377249:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 112 00000100:00100000:2.0:1788843080.377259:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+5:5584:x1875737775702272:12345-192.168.203.29@tcp:101: 00010000:00010000:2.0:1788843080.377276:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843080.377294:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914c67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084714 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843080.377334:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084714 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843080.377373:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084714 expref: 6 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843080.377399:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4000, rc 0) 00000100:00100000:2.0:1788843080.377453:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+6:5584:x1875737775702272:12345-192.168.203.29@tcp:101: Request processed in 195us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843080.377459:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 112 00000100:00100000:3.0:1788843080.379269:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843080.379423:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775702400 00000100:00100000:2.0:1788843080.379435:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775702400 00000100:00100000:2.0:1788843080.379497:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 113 00000100:00100000:2.0:1788843080.379508:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+6:5584:x1875737775702400:12345-192.168.203.29@tcp:501: 00000100:00100000:2.0:1788843080.380065:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+6:5584:x1875737775702400:12345-192.168.203.29@tcp:501: Request processed in 557us (804us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843080.380075:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 113 00000100:00100000:3.0:1788843080.382445:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843080.382712:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775702528 00000100:00100000:2.0:1788843080.382726:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775702528 00000100:00100000:2.0:1788843080.382791:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 114 00000100:00100000:2.0:1788843080.382801:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+6:5584:x1875737775702528:12345-192.168.203.29@tcp:101: 00010000:00010000:2.0:1788843080.382821:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843080.382841:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914c6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c60708471b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843080.382876:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708471b expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843080.382889:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708471b expref: 7 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843080.382900:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c5800, rc 0) 00000100:00100000:2.0:1788843080.383024:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+7:5584:x1875737775702528:12345-192.168.203.29@tcp:101: Request processed in 224us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843080.383032:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 114 00000100:00100000:3.0:1788843080.387458:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843080.390031:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775702656 00000100:00100000:1.0:1788843080.390057:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775702656 00000100:00100000:1.0:1788843080.390122:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 115 00000100:00100000:1.0:1788843080.390133:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+7:5584:x1875737775702656:12345-192.168.203.29@tcp:501: 00000100:00100000:1.0:1788843080.391196:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+8:5584:x1875737775702656:12345-192.168.203.29@tcp:501: Request processed in 1055us (3740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843080.391210:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 115 00000100:00100000:0.0:1788843080.403554:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843080.403684:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775702784 00000100:00100000:3.0:1788843080.403696:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775702784 00000100:00100000:3.0:1788843080.403759:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 116 00000100:00100000:3.0:1788843080.403770:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+8:5584:x1875737775702784:12345-192.168.203.29@tcp:503: 00000100:00100000:3.0:1788843080.404134:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+8:5584:x1875737775702784:12345-192.168.203.29@tcp:503: Request processed in 363us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843080.404142:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 116 00000100:00100000:3.0:1788843080.416144:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843080.417018:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775702912 00000100:00100000:0.0:1788843080.417036:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775702912 00000100:00100000:0.0:1788843080.417118:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 117 00000100:00100000:0.0:1788843080.417130:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+8:5603:x1875737775702912:12345-192.168.203.29@tcp:502: 00000100:00100000:0.0:1788843080.417564:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+8:5603:x1875737775702912:12345-192.168.203.29@tcp:502: Request processed in 435us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843080.417574:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 117 00000100:00100000:0.0:1788843080.448298:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843080.448460:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775703040 00000100:00100000:1.0:1788843080.448471:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775703040 00000100:00100000:1.0:1788843080.448525:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 118 00000100:00100000:1.0:1788843080.448544:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+8:5603:x1875737775703040:12345-192.168.203.29@tcp:502: 00000100:00100000:1.0:1788843080.449105:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+8:5603:x1875737775703040:12345-192.168.203.29@tcp:502: Request processed in 560us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843080.449114:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 118 00010000:00010000:1.0:1788843080.452629:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843080.462610:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843080.462661:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775703168 00000100:00100000:2.0:1788843080.462674:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775703168 00000100:00100000:2.0:1788843080.462739:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 119 00000100:00100000:2.0:1788843080.462752:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+8:5584:x1875737775703168:12345-192.168.203.29@tcp:101: 00010000:00010000:2.0:1788843080.462775:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843080.462797:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff89000/0xc6b8ac1b0914c75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084745 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843080.462832:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff89000/0xc6b8ac1b0914c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084745 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843080.463145:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff89000/0xc6b8ac1b0914c75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084745 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843080.463157:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89000, rc 0) 00000100:00100000:2.0:1788843080.463220:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+9:5584:x1875737775703168:12345-192.168.203.29@tcp:101: Request processed in 470us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843080.463229:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 119 00000100:00100000:3.0:1788843080.472663:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843080.476299:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775703296 00000100:00100000:1.0:1788843080.476327:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775703296 00000100:00100000:1.0:1788843080.476428:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 120 00000100:00100000:1.0:1788843080.476439:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+9:5584:x1875737775703296:12345-192.168.203.29@tcp:256: 20000000:01000000:1.0:1788843080.476469:0:5841:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788843080.476516:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788843080.476521:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788843080.476524:0:5841:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788843080.476526:0:5841:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788843080.481113:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+9:5584:x1875737775703296:12345-192.168.203.29@tcp:256: Request processed in 4662us (8448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843080.481127:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 120 00000100:00100000:0.0:1788843080.488221:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843080.488735:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775703424 00000100:00100000:3.0:1788843080.488747:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775703424 00000100:00100000:3.0:1788843080.488811:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 121 00000100:00100000:3.0:1788843080.488824:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+9:5584:x1875737775703424:12345-192.168.203.29@tcp:101: 00010000:00010000:3.0:1788843080.488853:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843080.488874:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914c7c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c60708474c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843080.488906:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914c7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708474c expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843080.488927:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914c7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708474c expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843080.488937:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41533600, rc 0) 00000100:00100000:3.0:1788843080.488996:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:5584:x1875737775703424:12345-192.168.203.29@tcp:101: Request processed in 175us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843080.489003:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 121 00000100:00100000:2.0:1788843080.492767:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843080.493185:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775703552 00000100:00100000:1.0:1788843080.493195:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775703552 00000100:00100000:1.0:1788843080.493257:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 122 00000100:00100000:1.0:1788843080.493268:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:5584:x1875737775703552:12345-192.168.203.29@tcp:501: 00000100:00100000:1.0:1788843080.493640:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:5584:x1875737775703552:12345-192.168.203.29@tcp:501: Request processed in 373us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843080.493649:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 122 00000100:00100000:3.0:1788843080.495686:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843080.495770:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775703680 00000100:00100000:0.0:1788843080.495781:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775703680 00000100:00100000:0.0:1788843080.495836:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 123 00000100:00100000:0.0:1788843080.496118:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:5584:x1875737775703680:12345-192.168.203.29@tcp:503: 00000100:00100000:0.0:1788843080.496564:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:5584:x1875737775703680:12345-192.168.203.29@tcp:503: Request processed in 448us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843080.499058:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 123 00000100:00100000:0.0:1788843080.500401:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843080.500443:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775703808 00000100:00100000:0.0:1788843080.500455:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775703808 00000100:00100000:0.0:1788843080.500508:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 124 00000100:00100000:0.0:1788843080.500519:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:5608:x1875737775703808:12345-192.168.203.29@tcp:502: 00000100:00100000:0.0:1788843080.500792:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:5608:x1875737775703808:12345-192.168.203.29@tcp:502: Request processed in 274us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843080.500811:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 124 00000100:00100000:1.0:1788843080.511228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843080.511269:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775703936 00000100:00100000:1.0:1788843080.511280:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775703936 00000100:00100000:1.0:1788843080.511380:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 125 00000100:00100000:1.0:1788843080.511391:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:5608:x1875737775703936:12345-192.168.203.29@tcp:502: 00000100:00100000:1.0:1788843080.511657:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:5608:x1875737775703936:12345-192.168.203.29@tcp:502: Request processed in 266us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843080.511666:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 125 00000100:00100000:2.0:1788843080.515723:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843080.515862:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775704064 00000100:00100000:3.0:1788843080.515875:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775704064 00000100:00100000:3.0:1788843080.515941:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:3.0:1788843080.515951:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2355:x1875737775704064:12345-192.168.203.29@tcp:38: 00010000:00080000:3.0:1788843080.516002:0:5846:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:3.0:1788843080.516064:0:5846:0:(genops.c:1385:class_connect()) connect: client fb38c5ab-0241-4970-81c2-7e93fb808128, cookie 0xc6b8ac1b0914c83 00000004:00100000:3.0:1788843080.516109:0:5846:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788843080.516118:0:5846:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788843080.580006:0:5846:0:(import.c:65:import_set_state_nolock()) ffff8dab7c18d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788843080.580102:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2355:x1875737775704064:12345-192.168.203.29@tcp:38: Request processed in 64150us (64394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843080.580113:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00010000:00010000:3.0:1788843081.476617:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843081.588626:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843081.588797:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775704320 00000100:00100000:2.0:1788843081.588807:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775704320 00000100:00100000:2.0:1788843081.588889:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:2.0:1788843081.588900:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:5584:x1875737775704320:12345-192.168.203.29@tcp:41: 00000004:00000024:2.0:1788843081.588970:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261385216 avail 2259288064 00000100:00100000:2.0:1788843081.589058:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:5584:x1875737775704320:12345-192.168.203.29@tcp:41: Request processed in 159us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843081.589066:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:1.0:1788843081.589285:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00080000:0.0:1788843081.589638:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843081.589695:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775704192 00000100:00100000:2.0:1788843081.589701:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775704192 00000100:00100000:2.0:1788843081.589784:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:2.0:1788843081.589792:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:0:x1875737775704192:12345-192.168.203.29@tcp:41: 00000004:00000024:2.0:1788843081.589809:0:7168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261385216 avail 2259288064 00000100:00100000:2.0:1788843081.589860:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:0:x1875737775704192:12345-192.168.203.29@tcp:41: Request processed in 68us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843081.589867:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:1.0:1788843081.594882:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843081.594990:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775704448 00000100:00100000:2.0:1788843081.595001:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775704448 00000100:00100000:2.0:1788843081.595058:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1788843081.595071:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:5584:x1875737775704448:12345-192.168.203.29@tcp:40: 00000100:00100000:2.0:1788843081.595163:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:5584:x1875737775704448:12345-192.168.203.29@tcp:40: Request processed in 96us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843081.595171:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:1.0:1788843081.601814:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843081.602057:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843081.602460:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843081.602491:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843081.602527:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775704960 00000100:00100000:1.0:1788843081.602537:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775704960 00000100:00100000:1.0:1788843081.602586:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 126 00000100:00100000:1.0:1788843081.602596:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2359:x1875737775704960:12345-192.168.203.29@tcp:400: 00000100:00100000:1.0:1788843081.602673:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2359:x1875737775704960:12345-192.168.203.29@tcp:400: Request processed in 79us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843081.602682:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 126 00000100:00100000:0.0:1788843081.603040:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775704832 00000100:00100000:0.0:1788843081.603045:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775704832 00000100:00100000:0.0:1788843081.603096:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:0.0:1788843081.603104:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+6:5584:x1875737775704832:12345-192.168.203.29@tcp:33: 00000100:00100000:2.0:1788843081.605996:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775704576 00000100:00100000:2.0:1788843081.606015:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775704576 00000100:00100000:1.0:1788843081.606310:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775704704 00000100:00100000:1.0:1788843081.606315:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775704704 00000100:00100000:1.0:1788843081.606338:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:1.0:1788843081.606363:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1875737775704576:12345-192.168.203.29@tcp:8: 00010000:00080000:1.0:1788843081.606396:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:1.0:1788843081.606428:0:6693:0:(genops.c:1385:class_connect()) connect: client fb38c5ab-0241-4970-81c2-7e93fb808128, cookie 0xc6b8ac1b0914c8a 00002000:00100000:1.0:1788843081.606439:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fb38c5ab-0241-4970-81c2-7e93fb808128/ffff8dab73d8b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788843081.606473:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788843081.607051:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1788843081.607294:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788843081.607306:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788843081.607517:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:2.0:1788843081.607525:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1875737775704704:12345-192.168.203.29@tcp:8: 00010000:00080000:2.0:1788843081.607548:0:8216:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp t0 exp 0000000000000000 cur 205 last 0 00000020:00000080:2.0:1788843081.607574:0:8216:0:(genops.c:1385:class_connect()) connect: client fb38c5ab-0241-4970-81c2-7e93fb808128, cookie 0xc6b8ac1b0914c91 00002000:00100000:2.0:1788843081.607581:0:8216:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fb38c5ab-0241-4970-81c2-7e93fb808128/ffff8dab6e6e2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788843081.607597:0:8216:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788843081.607718:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8dab73d8b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843081.607785:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2355:x1875737775704576:12345-192.168.203.29@tcp:8: Request processed in 1422us (5981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843081.607793:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00002000:00080000:2.0:1788843081.610578:0:8216:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788843081.610626:0:8216:0:(import.c:65:import_set_state_nolock()) ffff8dab6e6e1000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843081.610711:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2355:x1875737775704704:12345-192.168.203.29@tcp:8: Request processed in 3183us (8652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843081.610723:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000004:00080000:0.0:1788843081.627116:0:5849:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 23937us 00000004:00200000:0.0:1788843081.643403:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788843081.643545:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+6:5584:x1875737775704832:12345-192.168.203.29@tcp:33: Request processed in 40436us (41080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843081.643556:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:2.0:1788843081.828511:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843081.828581:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775705088 00000100:00100000:0.0:1788843081.828591:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775705088 00000100:00100000:0.0:1788843081.828655:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:0.0:1788843081.828666:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:5625:x1875737775705088:12345-192.168.203.29@tcp:101: 00010000:00010000:0.0:1788843081.828685:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843081.828710:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab40031600/0xc6b8ac1b0914c98 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084776 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843081.828770:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab40030600/0xc6b8ac1b0914c9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843081.828783:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab40030600/0xc6b8ac1b0914c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843081.828798:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab40030600/0xc6b8ac1b0914c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843081.828850:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788843081.828854:0:7168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788843081.828870:0:7168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab40030600/0xc6b8ac1b0914c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843081.828909:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab40031600/0xc6b8ac1b0914c98 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084776 expref: 8 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843081.828928:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab40030600/0xc6b8ac1b0914c9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084776 expref: 7 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843081.828937:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43ece700) 00010000:00010000:0.0:1788843081.828940:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788843081.828944:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab40030600, rc 0) 00000100:00100000:0.0:1788843081.829010:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+7:5625:x1875737775705088:12345-192.168.203.29@tcp:101: Request processed in 346us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843081.829018:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:0.0:1788843082.052630:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843082.052659:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795648384:0@lo:13: 00000100:00100000:0.0:1788843082.052730:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843082.052897:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795648384 00000100:00100000:2.0:1788843082.052915:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795648384 00000100:00100000:2.0:1788843082.052991:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788843082.053001:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795648384:12345-0@lo:13: 00002000:00000024:2.0:1788843082.053027:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788843082.053106:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795648384:12345-0@lo:13: Request processed in 106us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843082.053114:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1788843082.053201:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7bcafb80 x1875737795648384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843082.053221:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795648384:0@lo:13: 00000100:00080000:0.0:1788843082.053291:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788843082.500539:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843083.076676:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795648512:0@lo:400: 00000100:00100000:1.0:1788843083.076749:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795648896:0@lo:400: 00000100:00100000:2.0:1788843083.076770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843083.076858:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795649024:0@lo:400: 00000100:00100000:0.0:1788843083.076883:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795648768:0@lo:400: 00000100:00100000:3.0:1788843083.076940:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795648640:0@lo:400: 00000100:00100000:1.0:1788843083.077398:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843083.077445:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795648512 00000100:00100000:1.0:1788843083.077453:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795648512 00000100:00100000:1.0:1788843083.077497:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788843083.077506:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795648512:12345-0@lo:400: 00000100:00100000:1.0:1788843083.077561:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795648512:12345-0@lo:400: Request processed in 55us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843083.077569:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788843083.077617:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795648896 00000100:00100000:1.0:1788843083.077621:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795648896 00000100:00100000:1.0:1788843083.077646:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843083.077653:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795648896:12345-0@lo:400: 00000100:00100000:1.0:1788843083.077691:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51456a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795648896:12345-0@lo:400: Request processed in 38us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843083.077714:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843083.077715:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788843083.077770:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab51455c00 x1875737795648896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843083.077785:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795648896:0@lo:400: 00000100:00100000:1.0:1788843083.077817:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795649024 00000100:00100000:1.0:1788843083.077822:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795649024 00000100:00100000:1.0:1788843083.077864:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788843083.077871:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795649024:12345-0@lo:400: 00000100:00100000:1.0:1788843083.077926:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795649024:12345-0@lo:400: Request processed in 56us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843083.077932:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843083.077944:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795648512:0@lo:400: 00000100:00080000:1.0:1788843083.077954:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843083.077977:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795649024:0@lo:400: 00000100:00100000:0.0:1788843083.078627:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843083.078809:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795648768 00000100:00100000:2.0:1788843083.078817:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795648768 00000100:00080000:1.0:1788843083.078882:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843083.078907:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788843083.078916:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795648768:12345-0@lo:400: 00000100:00100000:2.0:1788843083.078989:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795648768:12345-0@lo:400: Request processed in 75us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843083.078997:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788843083.079224:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795648768:0@lo:400: 00000100:00100000:3.0:1788843083.079844:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843083.079882:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795649152:0@lo:400: 00000100:00100000:1.0:1788843083.079922:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795648640 00000100:00100000:3.0:1788843083.079924:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843083.079930:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795648640 00000100:00100000:1.0:1788843083.079985:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788843083.079994:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795648640:12345-0@lo:400: 00000100:00100000:1.0:1788843083.080051:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795648640:12345-0@lo:400: Request processed in 58us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843083.080059:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788843083.080139:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795649152 00000100:00100000:2.0:1788843083.080144:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795649152 00000100:00100000:2.0:1788843083.080193:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788843083.080202:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795649152:12345-0@lo:400: 00000100:00100000:2.0:1788843083.080243:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795649152:12345-0@lo:400: Request processed in 43us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843083.080249:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788843083.080519:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843083.080650:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795648640:0@lo:400: 00010000:00080000:3.0:1788843083.080665:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab51456680 x1875737795649152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843099 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843083.080674:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788843083.080686:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795649152:0@lo:400: 00010000:00010000:1.0:1788843083.525177:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843083.588965:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843083.588992:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795649280:0@lo:13: 00000100:00100000:3.0:1788843083.589139:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843083.589222:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795649280 00000100:00100000:2.0:1788843083.589232:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795649280 00000100:00100000:2.0:1788843083.589287:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788843083.589298:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795649280:12345-0@lo:13: 00002000:00000024:2.0:1788843083.589334:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788843083.589492:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795649280:12345-0@lo:13: Request processed in 196us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843083.589501:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788843083.591107:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab51455c00 x1875737795649280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843083.591137:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795649280:0@lo:13: 00000100:00100000:1.0:1788843084.061497:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843084.063950:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775705216 00000100:00100000:2.0:1788843084.063968:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775705216 00000100:00100000:2.0:1788843084.064072:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:2.0:1788843084.064085:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+7:5677:x1875737775705216:12345-192.168.203.29@tcp:41: 00000004:00000024:2.0:1788843084.064139:0:7168:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261385216 avail 2259288064 00000100:00100000:2.0:1788843084.064239:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51455500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+7:5677:x1875737775705216:12345-192.168.203.29@tcp:41: Request processed in 156us (2751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843084.064269:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00080000:1.0:1788843084.064409:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843084.071761:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843084.071846:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775705344 00000100:00100000:0.0:1788843084.071859:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775705344 00000100:00100000:0.0:1788843084.071943:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:0.0:1788843084.071955:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fb38c5ab-0241-4970-81c2-7e93fb808128+6:5677:x1875737775705344:12345-192.168.203.29@tcp:13: 00002000:00000024:0.0:1788843084.072012:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843084.072089:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fb38c5ab-0241-4970-81c2-7e93fb808128+6:5677:x1875737775705344:12345-192.168.203.29@tcp:13: Request processed in 136us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843084.072097:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00080000:1.0:1788843084.072213:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843084.075694:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843084.076025:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775705472 00000100:00100000:0.0:1788843084.076038:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775705472 00000100:00100000:0.0:1788843084.076165:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:0.0:1788843084.076178:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fb38c5ab-0241-4970-81c2-7e93fb808128+6:5677:x1875737775705472:12345-192.168.203.29@tcp:13: 00002000:00000024:0.0:1788843084.076210:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843084.076290:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fb38c5ab-0241-4970-81c2-7e93fb808128+6:5677:x1875737775705472:12345-192.168.203.29@tcp:13: Request processed in 113us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843084.076310:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00080000:1.0:1788843084.080723:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1788843084.126049:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fb38c5ab-0241-4970-81c2-7e93fb808128 00010000:00010000:2.0:1788843084.552936:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843085.572969:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788843085.788209:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fb38c5ab-0241-4970-81c2-7e93fb808128 00000001:00100000:2.0:1788843086.258509:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fb38c5ab-0241-4970-81c2-7e93fb808128 00010000:00010000:1.0:1788843086.596512:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788843086.841155:0:8304:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788843086.994446:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843086.994505:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843086.994532:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843086.994533:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775705856 00000100:00100000:1.0:1788843086.994545:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775705856 00000100:00100000:0.0:1788843086.994561:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843086.994587:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775705728 00000100:00100000:0.0:1788843086.994591:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775705728 00000100:00100000:1.0:1788843086.994619:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775705984 00000100:00100000:1.0:1788843086.994622:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775705984 00000100:00100000:0.0:1788843086.994639:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:1.0:1788843086.994645:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:1.0:1788843086.994652:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2356:x1875737775705856:12345-192.168.203.29@tcp:400: 00000100:00100000:0.0:1788843086.994652:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2356:x1875737775705728:12345-192.168.203.29@tcp:400: 00000100:00100000:2.0:1788843086.994745:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775705600 00000100:00100000:2.0:1788843086.994750:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775705600 00000100:00100000:2.0:1788843086.994785:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 128 00000100:00100000:2.0:1788843086.994793:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2356:x1875737775705600:12345-192.168.203.29@tcp:400: 00000100:00100000:0.0:1788843086.994877:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2356:x1875737775705728:12345-192.168.203.29@tcp:400: Request processed in 227us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843086.994886:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:1.0:1788843086.994921:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2356:x1875737775705856:12345-192.168.203.29@tcp:400: Request processed in 269us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843086.994929:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:1.0:1788843086.994942:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:1.0:1788843086.994949:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2356:x1875737775705984:12345-192.168.203.29@tcp:400: 00000100:00100000:1.0:1788843086.994973:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2356:x1875737775705984:12345-192.168.203.29@tcp:400: Request processed in 25us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843086.994980:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00080000:1.0:1788843086.995001:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788843086.995008:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843086.995010:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843086.995527:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2356:x1875737775705600:12345-192.168.203.29@tcp:400: Request processed in 730us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843086.995536:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 128 00000100:00100000:2.0:1788843087.178088:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795649408:0@lo:13: 00000100:00100000:2.0:1788843087.178203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843087.178336:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795649408 00000100:00100000:2.0:1788843087.178366:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795649408 00000100:00100000:2.0:1788843087.178445:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843087.178458:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795649408:12345-0@lo:13: 00002000:00000024:2.0:1788843087.178506:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788843087.178567:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec48e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795649408:12345-0@lo:13: Request processed in 110us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843087.178576:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788843087.178604:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788843087.178645:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6ec48a80 x1875737795649408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843087.178670:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795649408:0@lo:13: 00010000:00010000:1.0:1788843087.626227:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843088.197309:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843088.197508:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795649664:0@lo:400: 00000100:00100000:0.0:1788843088.197577:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843088.197670:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795649536:0@lo:400: 00000100:00100000:0.0:1788843088.197710:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843088.197750:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795649536 00000100:00100000:0.0:1788843088.197757:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795649536 00000100:00100000:0.0:1788843088.197802:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788843088.197810:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795649536:12345-0@lo:400: 00000100:00100000:0.0:1788843088.197874:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795649536:12345-0@lo:400: Request processed in 64us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843088.197882:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788843088.197934:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795649536:0@lo:400: 00000100:00100000:0.0:1788843088.198086:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795650176:0@lo:400: 00000100:00100000:0.0:1788843088.198188:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843088.198219:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843088.198225:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795650048:0@lo:400: 00000100:00100000:0.0:1788843088.198247:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843088.198287:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795650176 00000100:00100000:3.0:1788843088.198292:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795650176 00000100:00100000:3.0:1788843088.198334:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788843088.198361:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795650176:12345-0@lo:400: 00000100:00100000:3.0:1788843088.198399:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795650176:12345-0@lo:400: Request processed in 58us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843088.198406:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788843088.198617:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795649792:0@lo:400: 00010000:00080000:0.0:1788843088.198767:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7c180000 x1875737795650176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843088.198781:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795650176:0@lo:400: 00000100:00100000:0.0:1788843088.198804:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843088.198847:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795649664 00000100:00100000:2.0:1788843088.198852:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795649664 00000100:00100000:2.0:1788843088.198898:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795650048 00000100:00100000:2.0:1788843088.198901:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795650048 00000100:00100000:2.0:1788843088.198925:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788843088.198932:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795649664:12345-0@lo:400: 00000100:00100000:2.0:1788843088.198987:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795649664:12345-0@lo:400: Request processed in 55us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843088.198994:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788843088.199008:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788843088.199014:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795650048:12345-0@lo:400: 00000100:00100000:2.0:1788843088.199045:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795650048:12345-0@lo:400: Request processed in 31us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843088.199051:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788843088.199085:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795649920:0@lo:400: 00000100:00100000:2.0:1788843088.199123:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788843088.199154:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843088.199158:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843088.199173:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795649920 00000100:00100000:2.0:1788843088.199176:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795649920 00000100:00100000:2.0:1788843088.199199:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843088.199205:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795649920:12345-0@lo:400: 00000100:00100000:2.0:1788843088.199242:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec48a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795649920:12345-0@lo:400: Request processed in 36us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843088.199248:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788843088.199276:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7c181880 x1875737795649920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843104 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843088.199304:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795649920:0@lo:400: 00000100:00100000:2.0:1788843088.199330:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795650048:0@lo:400: 00000100:00100000:2.0:1788843088.199361:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795649664:0@lo:400: 00000100:00100000:3.0:1788843088.199622:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795649792 00000100:00100000:3.0:1788843088.199626:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795649792 00000100:00100000:2.0:1788843088.199705:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788843088.199713:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795649792:12345-0@lo:400: 00000100:00100000:2.0:1788843088.199755:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795649792:12345-0@lo:400: Request processed in 42us (949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843088.199761:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788843088.199788:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795649792:0@lo:400: 00000100:00080000:0.0:1788843088.199823:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788843088.644594:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843088.713700:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795650304:0@lo:13: 00000100:00100000:1.0:1788843088.713798:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843088.713991:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795650304 00000100:00100000:1.0:1788843088.714003:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795650304 00000100:00100000:1.0:1788843088.714072:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788843088.714083:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795650304:12345-0@lo:13: 00002000:00000024:1.0:1788843088.714137:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843088.714194:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795650304:12345-0@lo:13: Request processed in 111us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843088.714212:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788843088.714264:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab51454a80 x1875737795650304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843088.714286:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795650304:0@lo:13: 00010000:00010000:0.0:1788843089.670398:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788843090.046007:0:8452:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7183c070 20000000:00000080:1.0:1788843090.046027:0:8452:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dab4932e400 uarg=0000000000000000 20000000:01000000:1.0:1788843090.046067:0:8452:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1788843090.046070:0:8452:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1788843090.046072:0:8452:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788843090.046079:0:8452:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:1.0:1788843090.046086:0:8452:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:1.0:1788843090.046102:0:8452:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788843090.046105:0:8452:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788843090.046940:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788843090.046945:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788843090.048056:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1788843090.048968:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1788843090.049030:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1788843090.049090:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1788843090.049105:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788843090.049108:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788843090.050143:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788843090.050973:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788843090.051047:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1788843090.051085:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1788843090.051098:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788843090.051101:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788843090.052551:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788843090.053202:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788843090.053334:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788843090.053577:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1788843090.053596:0:8452:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788843090.053599:0:8452:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788843090.055000:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1788843090.055898:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1788843090.055980:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1788843090.056022:0:8452:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:1.0:1788843090.056040:0:8452:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788843090.056068:0:8452:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914ca6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.056088:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab821c4200/0xc6b8ac1b0914ba3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914b9c expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.056095:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab821c4a00/0xc6b8ac1b0914bcd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914bc6 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.056102:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab40030400/0xc6b8ac1b0914bf7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914bf0 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.056108:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab821c4e00/0xc6b8ac1b0914c05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914bfe expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.056114:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914c13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914c0c expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.056121:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914c2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914c28 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.056128:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab40030a00/0xc6b8ac1b0914c59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914c4b expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.056138:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914c67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084714 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.056145:0:8452:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914c6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708471b expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.056160:0:8452:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914ca6 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.056207:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914c6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708471b expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.056226:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914c6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708471b expref: 9 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843090.056245:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875737795650432:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843090.056692:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914c67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084714 expref: 9 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.056701:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914c67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084714 expref: 9 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843090.056710:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51455880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875737795650560:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843090.056751:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab40030a00/0xc6b8ac1b0914c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914c4b expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.056760:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab40030a00/0xc6b8ac1b0914c59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914c4b expref: 18 pid: 5841 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843090.056770:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51456d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875737795650688:0@lo:104: 00000100:00100000:1.0:1788843090.056811:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843090.056862:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914c28 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.056884:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914c2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914c28 expref: 18 pid: 5841 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843090.056893:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51457b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875737795650816:0@lo:104: 00000100:00100000:1.0:1788843090.056919:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843090.057004:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914c0c expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.057012:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914c13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914c0c expref: 18 pid: 5840 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843090.057020:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51455180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875737795650944:0@lo:104: 00010000:00010000:1.0:1788843090.057044:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab821c4e00/0xc6b8ac1b0914c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914bfe expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.057052:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab821c4e00/0xc6b8ac1b0914c05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914bfe expref: 18 pid: 5841 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843090.057059:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51455f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875737795651072:0@lo:104: 00010000:00010000:1.0:1788843090.057084:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab40030400/0xc6b8ac1b0914bf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914bf0 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.057091:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab40030400/0xc6b8ac1b0914bf7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914bf0 expref: 18 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843090.057100:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51456300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875737795651200:0@lo:104: 00010000:00010000:1.0:1788843090.057124:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab821c4a00/0xc6b8ac1b0914bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914bc6 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.057142:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab821c4a00/0xc6b8ac1b0914bcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914bc6 expref: 18 pid: 5840 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843090.057151:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51457480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875737795651328:0@lo:104: 00010000:00010000:1.0:1788843090.057177:0:8452:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab821c4200/0xc6b8ac1b0914ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914b9c expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843090.057184:0:8452:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab821c4200/0xc6b8ac1b0914ba3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b9c expref: 18 pid: 5840 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843090.057191:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875737795651456:0@lo:104: 00000100:00100000:1.0:1788843090.057208:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab514a83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843090.060708:0:5829:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788843090.060760:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843090.060782:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843090.060793:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843090.060803:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843090.060815:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843090.060859:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795650688 00000100:00100000:2.0:1788843090.060869:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795650688 00000100:00100000:2.0:1788843090.060908:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795650816 00000100:00100000:2.0:1788843090.060911:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795650816 00000100:00100000:2.0:1788843090.060921:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795650944 00000100:00100000:2.0:1788843090.060923:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795650944 00000100:00100000:2.0:1788843090.060931:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795651072 00000100:00100000:2.0:1788843090.060939:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795651072 00000100:00100000:2.0:1788843090.060952:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795651200 00000100:00100000:2.0:1788843090.060955:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795651200 00000100:00100000:2.0:1788843090.060963:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795651328 00000100:00100000:2.0:1788843090.060965:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795651328 00000100:00100000:2.0:1788843090.060973:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795651456 00000100:00100000:2.0:1788843090.060975:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795651456 00000100:00100000:2.0:1788843090.060986:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843090.060995:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51454000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+9:8452:x1875737795650688:12345-0@lo:104: 00010000:00010000:2.0:1788843090.061012:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914c4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914c59 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843090.061108:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788843090.061114:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51454000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+9:8452:x1875737795650688:12345-0@lo:104: Request processed in 120us (4303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843090.061121:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843090.061142:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788843090.061149:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+8:8452:x1875737795650816:12345-0@lo:104: 00010000:00010000:2.0:1788843090.061156:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914c28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914c2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843090.061194:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788843090.061199:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51a2b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+8:8452:x1875737795650816:12345-0@lo:104: Request processed in 52us (4280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843090.061205:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788843090.061238:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788843090.061244:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+7:8452:x1875737795650944:12345-0@lo:104: 00010000:00010000:2.0:1788843090.061251:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0914c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914c13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843090.061467:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51456d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875737795650688:0@lo:104: 00000100:00100000:1.0:1788843090.061478:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51457b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875737795650816:0@lo:104: 00010000:00010000:2.0:1788843090.061736:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788843090.061742:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec49500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+7:8452:x1875737795650944:12345-0@lo:104: Request processed in 499us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843090.061748:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788843090.061763:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788843090.061769:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+6:8452:x1875737795651072:12345-0@lo:104: 00010000:00010000:2.0:1788843090.061778:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0914bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914c05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843090.061816:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788843090.061821:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+6:8452:x1875737795651072:12345-0@lo:104: Request processed in 53us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843090.061827:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788843090.061840:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843090.061856:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+5:8452:x1875737795651200:12345-0@lo:104: 00010000:00010000:2.0:1788843090.061863:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab4933bc00/0xc6b8ac1b0914bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914bf7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843090.061890:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788843090.061894:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec4a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+5:8452:x1875737795651200:12345-0@lo:104: Request processed in 50us (1100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843090.061899:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843090.061909:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843090.061920:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+4:8452:x1875737795651328:12345-0@lo:104: 00010000:00010000:2.0:1788843090.061927:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab41532400/0xc6b8ac1b0914bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914bcd expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843090.061963:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788843090.061968:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+4:8452:x1875737795651328:12345-0@lo:104: Request processed in 49us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843090.061974:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843090.061987:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788843090.061994:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+3:8452:x1875737795651456:12345-0@lo:104: 00010000:00010000:2.0:1788843090.062002:0:5829:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab41532e00/0xc6b8ac1b0914b9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914ba3 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843090.062028:0:5829:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788843090.062032:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:28cf63da-daee-485f-b466-4ec68876f732+3:8452:x1875737795651456:12345-0@lo:104: Request processed in 40us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843090.062038:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788843090.062145:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51455180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875737795650944:0@lo:104: 00000100:00100000:1.0:1788843090.062154:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51455f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875737795651072:0@lo:104: 00000100:00100000:1.0:1788843090.062161:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51456300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875737795651200:0@lo:104: 00000100:00100000:1.0:1788843090.062168:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51457480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875737795651328:0@lo:104: 00000100:00100000:1.0:1788843090.062176:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875737795651456:0@lo:104: 00010000:00010000:0.0:1788843090.062390:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1788843090.062398:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914c4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914c59 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062415:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40031c00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843090.062421:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914c4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914c59 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062447:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914c4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914c59 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843090.062455:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914c4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914c59 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843090.062462:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843090.062510:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914c4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914c59 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062517:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843090.062537:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914c4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914c59 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062545:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab40031c00/0xc6b8ac1b0914c4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914c59 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062560:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788843090.062564:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914c28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914c2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062570:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4c00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843090.062573:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914c28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914c2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062580:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914c2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843090.062587:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914c28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914c2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843090.062598:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843090.062614:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914c28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914c2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062620:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843090.062634:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914c28 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914c2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062640:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c4c00/0xc6b8ac1b0914c28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914c2f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062650:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788843090.062653:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0914c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914c13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062658:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5e00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843090.062662:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0914c0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914c13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062668:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0914c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914c13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843090.062674:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0914c0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914c13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843090.062678:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843090.062690:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0914c0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914c13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062697:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843090.062709:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0914c0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914c13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062717:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0914c0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914c13 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062740:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788843090.062744:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0914bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914c05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062751:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933ba00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843090.062755:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0914bfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914c05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062761:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0914bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914c05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843090.062768:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0914bfe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914c05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843090.062774:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843090.062787:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0914bfe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914c05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062793:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843090.062797:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0914bfe lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914c05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062804:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0914bfe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914c05 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062814:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788843090.062823:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab4933bc00/0xc6b8ac1b0914bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914bf7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062828:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933bc00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843090.062831:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933bc00/0xc6b8ac1b0914bf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914bf7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062837:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab4933bc00/0xc6b8ac1b0914bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914bf7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843090.062855:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933bc00/0xc6b8ac1b0914bf0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914bf7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843090.062860:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843090.062876:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab4933bc00/0xc6b8ac1b0914bf0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914bf7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062881:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843090.062886:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab4933bc00/0xc6b8ac1b0914bf0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914bf7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062892:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab4933bc00/0xc6b8ac1b0914bf0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914bf7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062901:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843090.062905:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab41532400/0xc6b8ac1b0914bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914bcd expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062910:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41532400 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843090.062913:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab41532400/0xc6b8ac1b0914bc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914bcd expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062931:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab41532400/0xc6b8ac1b0914bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914bcd expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843090.062938:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab41532400/0xc6b8ac1b0914bc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914bcd expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843090.062942:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843090.062956:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab41532400/0xc6b8ac1b0914bc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914bcd expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062961:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843090.062965:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab41532400/0xc6b8ac1b0914bc6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914bcd expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062972:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab41532400/0xc6b8ac1b0914bc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914bcd expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062982:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843090.062985:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab41532e00/0xc6b8ac1b0914b9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914ba3 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062990:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41532e00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843090.062993:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab41532e00/0xc6b8ac1b0914b9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914ba3 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.062999:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab41532e00/0xc6b8ac1b0914b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914ba3 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843090.063004:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab41532e00/0xc6b8ac1b0914b9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914ba3 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843090.063015:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843090.063029:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab41532e00/0xc6b8ac1b0914b9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914ba3 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.063034:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843090.063038:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab41532e00/0xc6b8ac1b0914b9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914ba3 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.063043:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab41532e00/0xc6b8ac1b0914b9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914ba3 expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.063062:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843090.063064:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843090.063066:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843090.063086:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795651584:0@lo:103: 00000100:00100000:0.0:1788843090.063146:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843090.063191:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795652096:0@lo:103: 00000100:00100000:0.0:1788843090.063211:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843090.063231:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843090.063236:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795651968:0@lo:103: 00000100:00100000:0.0:1788843090.063252:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843090.063795:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795651712:0@lo:103: 00000100:00100000:0.0:1788843090.063820:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843090.063853:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795652224:0@lo:103: 00000100:00100000:0.0:1788843090.063873:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843090.063892:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788843090.063898:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795651840:0@lo:103: 00000100:00100000:0.0:1788843090.063928:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843090.063937:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795652352:0@lo:103: 00000100:00100000:0.0:1788843090.063953:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843090.063978:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795651584 00000100:00100000:0.0:1788843090.063985:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795651584 00010000:00010000:0.0:1788843090.064017:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab40030a00/0xc6b8ac1b0914c59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914c4b expref: 19 pid: 5841 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843090.064037:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795652096 00000100:00100000:0.0:1788843090.064040:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795652096 00010000:00010000:0.0:1788843090.064049:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab40030400/0xc6b8ac1b0914bf7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914bf0 expref: 20 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843090.064057:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795651968 00000100:00100000:0.0:1788843090.064060:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795651968 00010000:00010000:0.0:1788843090.064068:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab821c4e00/0xc6b8ac1b0914c05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914bfe expref: 21 pid: 5841 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843090.064077:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795651712 00000100:00100000:0.0:1788843090.064079:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795651712 00010000:00010000:0.0:1788843090.064088:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914c2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914c28 expref: 22 pid: 5841 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843090.064096:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795652224 00000100:00100000:0.0:1788843090.064098:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795652224 00010000:00010000:0.0:1788843090.064107:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab821c4a00/0xc6b8ac1b0914bcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914bc6 expref: 23 pid: 5840 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843090.064114:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795651840 00000100:00100000:0.0:1788843090.064116:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795651840 00010000:00010000:0.0:1788843090.064123:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914c13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914c0c expref: 24 pid: 5840 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843090.064143:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795652352 00000100:00100000:0.0:1788843090.064146:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795652352 00010000:00010000:0.0:1788843090.064156:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab821c4200/0xc6b8ac1b0914ba3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b9c expref: 25 pid: 5840 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843090.064167:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788843090.064175:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+25:3305:x1875737795651584:12345-0@lo:103: 00010000:00010000:0.0:1788843090.064189:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843090.064194:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab40030a00/0xc6b8ac1b0914c59 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914c4b expref: 25 pid: 5841 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.064203:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab40030a00/0xc6b8ac1b0914c59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914c4b expref: 25 pid: 5841 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.064218:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab40030a00/0xc6b8ac1b0914c59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914c4b expref: 25 pid: 5841 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.064233:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843090.064272:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+24:3305:x1875737795651584:12345-0@lo:103: Request processed in 98us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843090.064278:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788843090.064295:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788843090.064301:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+23:3305:x1875737795652096:12345-0@lo:103: 00010000:00010000:0.0:1788843090.064308:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843090.064312:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab40030400/0xc6b8ac1b0914bf7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914bf0 expref: 23 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.064320:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab40030400/0xc6b8ac1b0914bf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914bf0 expref: 23 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.064336:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab40030400/0xc6b8ac1b0914bf7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914bf0 expref: 23 pid: 5839 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.064365:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843090.064389:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+22:3305:x1875737795652096:12345-0@lo:103: Request processed in 87us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843090.064394:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788843090.064406:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788843090.064411:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+21:3305:x1875737795651968:12345-0@lo:103: 00010000:00010000:0.0:1788843090.064419:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843090.064423:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab821c4e00/0xc6b8ac1b0914c05 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914bfe expref: 21 pid: 5841 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.064676:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab821c4e00/0xc6b8ac1b0914c05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914bfe expref: 21 pid: 5841 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.064687:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab821c4e00/0xc6b8ac1b0914c05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914bfe expref: 21 pid: 5841 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.064696:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843090.064722:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd42a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+20:3305:x1875737795651968:12345-0@lo:103: Request processed in 310us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843090.064789:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788843090.064804:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788843090.064810:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795651712:12345-0@lo:103: 00010000:00010000:0.0:1788843090.064818:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843090.064824:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914c2f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914c28 expref: 19 pid: 5841 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.064839:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914c2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914c28 expref: 19 pid: 5841 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.064857:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab40031a00/0xc6b8ac1b0914c2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914c28 expref: 19 pid: 5841 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.064866:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843090.064997:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788843090.065007:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28cf63da-daee-485f-b466-4ec68876f732+18:3306:x1875737795652224:12345-0@lo:103: 00010000:00010000:3.0:1788843090.065016:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843090.065022:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab821c4a00/0xc6b8ac1b0914bcd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914bc6 expref: 18 pid: 5840 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.065210:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab821c4a00/0xc6b8ac1b0914bcd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914bc6 expref: 18 pid: 5840 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.065221:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab821c4a00/0xc6b8ac1b0914bcd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914bc6 expref: 18 pid: 5840 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.065230:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843090.065278:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+17:3306:x1875737795651712:12345-0@lo:103: Request processed in 468us (1457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843090.065285:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788843090.065301:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788843090.065307:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+16:3306:x1875737795651840:12345-0@lo:103: 00010000:00010000:0.0:1788843090.065316:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843090.065320:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914c13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914c0c expref: 16 pid: 5840 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.065328:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914c13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914c0c expref: 16 pid: 5840 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.065338:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab41532a00/0xc6b8ac1b0914c13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914c0c expref: 16 pid: 5840 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843090.065367:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843090.065862:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28cf63da-daee-485f-b466-4ec68876f732+15:3306:x1875737795652224:12345-0@lo:103: Request processed in 854us (1986us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843090.065870:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788843090.065901:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788843090.065908:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51553050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28cf63da-daee-485f-b466-4ec68876f732+14:3306:x1875737795652352:12345-0@lo:103: 00010000:00010000:3.0:1788843090.065917:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843090.065922:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab821c4200/0xc6b8ac1b0914ba3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b9c expref: 14 pid: 5840 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.065930:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab821c4200/0xc6b8ac1b0914ba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914b9c expref: 14 pid: 5840 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.065940:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab821c4200/0xc6b8ac1b0914ba3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914b9c expref: 14 pid: 5840 timeout: 364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.065949:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843090.065977:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51553050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28cf63da-daee-485f-b466-4ec68876f732+13:3306:x1875737795652352:12345-0@lo:103: Request processed in 70us (2021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843090.065982:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788843090.066110:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843090.066118:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843090.066125:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843090.066250:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+12:3306:x1875737795651840:12345-0@lo:103: Request processed in 942us (2320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843090.066257:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788843090.066403:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843090.066533:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775706112 00000100:00100000:3.0:1788843090.066540:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775706112 00010000:00010000:3.0:1788843090.066566:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914c6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708471b expref: 10 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843090.066588:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:3.0:1788843090.066594:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2358:x1875737775706112:12345-192.168.203.29@tcp:103: 00010000:00010000:3.0:1788843090.066602:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843090.066606:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914c6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708471b expref: 10 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.066616:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914c6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708471b expref: 10 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.066638:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843090.066678:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2358:x1875737775706112:12345-192.168.203.29@tcp:103: Request processed in 83us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843090.066684:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:0.0:1788843090.066875:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843090.066932:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795651968:0@lo:103: 00000100:00100000:0.0:1788843090.066945:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795651584:0@lo:103: 00000100:00100000:0.0:1788843090.066953:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795652096:0@lo:103: 00000100:00100000:3.0:1788843090.067052:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775706240 00000100:00100000:3.0:1788843090.067056:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775706240 00010000:00010000:3.0:1788843090.067071:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914c67 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084714 expref: 10 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843090.067098:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1788843090.067105:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2358:x1875737775706240:12345-192.168.203.29@tcp:103: 00010000:00010000:3.0:1788843090.067112:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843090.067116:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914c67 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084714 expref: 10 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.067125:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914c67 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084714 expref: 10 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.067138:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914ca6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.067147:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914ca6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.067162:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914ca6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.067168:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914ca6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.067186:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914ca6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.067194:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914ca6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.067200:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933a600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843090.067204:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914ca6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.067212:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914ca6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843090.067321:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab821c5800/0xc6b8ac1b0914c6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708471b expref: 10 pid: 5840 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843090.067336:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875737795650432:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843090.067367:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab821c4000/0xc6b8ac1b0914c67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084714 expref: 9 pid: 5841 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843090.067377:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51455880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8452:1875737795650560:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843090.067415:0:8452:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914ca6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.067563:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914ca6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843090.067572:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843090.067609:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+8:2358:x1875737775706240:12345-192.168.203.29@tcp:103: Request processed in 504us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843090.067616:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00010000:00010000:2.0:1788843090.067660:0:8452:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914ca6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843090.067667:0:8452:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914ca6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843090.067673:0:8452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914ca6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8452 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843090.068579:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795651712:0@lo:103: 00000100:00100000:1.0:1788843090.068594:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795652224:0@lo:103: 00000100:00100000:1.0:1788843090.068620:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc7aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795651840:0@lo:103: 00000100:00100000:1.0:1788843090.068629:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795652352:0@lo:103: 00010000:00010000:0.0:1788843090.692726:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843091.279798:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843091.280262:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775706368 00000100:00100000:2.0:1788843091.280274:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775706368 00000100:00100000:2.0:1788843091.280333:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 130 00000100:00100000:2.0:1788843091.280871:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+8:5598:x1875737775706368:12345-192.168.203.29@tcp:101: 00010000:00010000:2.0:1788843091.280893:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843091.280914:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff88600/0xc6b8ac1b0914cad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c60708477d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843091.281450:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff88600/0xc6b8ac1b0914cad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708477d expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843091.281468:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff88600/0xc6b8ac1b0914cad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708477d expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843091.281479:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88600, rc 0) 00000100:00100000:2.0:1788843091.281558:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+9:5598:x1875737775706368:12345-192.168.203.29@tcp:101: Request processed in 1209us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843091.281567:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 130 00000100:00100000:0.0:1788843091.289234:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843091.295209:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775706496 00000100:00100000:3.0:1788843091.295225:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775706496 00000100:00100000:3.0:1788843091.295303:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 131 00000100:00100000:3.0:1788843091.295315:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+9:5598:x1875737775706496:12345-192.168.203.29@tcp:501: 00000100:00100000:3.0:1788843091.295947:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+9:5598:x1875737775706496:12345-192.168.203.29@tcp:501: Request processed in 632us (6722us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843091.295956:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 131 00000100:00100000:0.0:1788843091.300164:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843091.300678:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775706624 00000100:00100000:2.0:1788843091.300718:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775706624 00000100:00100000:2.0:1788843091.300791:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 132 00000100:00100000:2.0:1788843091.300803:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+9:5598:x1875737775706624:12345-192.168.203.29@tcp:503: 00000100:00100000:2.0:1788843091.301092:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+9:5598:x1875737775706624:12345-192.168.203.29@tcp:503: Request processed in 291us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843091.301100:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 132 00000100:00100000:1.0:1788843091.308585:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843091.310013:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775706752 00000100:00100000:0.0:1788843091.310028:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775706752 00000100:00100000:0.0:1788843091.310208:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 133 00000100:00100000:0.0:1788843091.310219:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+9:6072:x1875737775706752:12345-192.168.203.29@tcp:502: 00000100:00100000:0.0:1788843091.312473:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+9:6072:x1875737775706752:12345-192.168.203.29@tcp:502: Request processed in 2245us (3888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843091.312485:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 133 00000100:00100000:0.0:1788843091.316740:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843091.316815:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775706880 00000100:00100000:3.0:1788843091.316847:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775706880 00000100:00100000:3.0:1788843091.316911:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 134 00000100:00100000:3.0:1788843091.316924:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+9:6072:x1875737775706880:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788843091.317199:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+9:6072:x1875737775706880:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 277us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843091.317207:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 134 00000100:00100000:2.0:1788843091.322571:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843091.322954:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775707008 00000100:00100000:0.0:1788843091.322963:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775707008 00000100:00100000:0.0:1788843091.323016:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 135 00000100:00100000:0.0:1788843091.323026:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+9:5598:x1875737775707008:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843091.323041:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843091.323057:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab40030a00/0xc6b8ac1b0914cb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084784 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.323084:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab40030a00/0xc6b8ac1b0914cb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084784 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.323095:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab40030a00/0xc6b8ac1b0914cb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084784 expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.323119:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab40030a00, rc 0) 00000100:00100000:0.0:1788843091.323400:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:5598:x1875737775707008:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 373us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843091.323407:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 135 00000100:00100000:1.0:1788843091.333704:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843091.334172:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775707136 00000100:00100000:2.0:1788843091.334182:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775707136 00000100:00100000:2.0:1788843091.334235:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 136 00000100:00100000:2.0:1788843091.334260:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:5598:x1875737775707136:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843091.334749:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:5598:x1875737775707136:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 490us (1053us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843091.334759:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 136 10000000:01000000:1.0:1788843091.588455:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788843091.588463:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dab51a7d800 from 39 10000000:01000000:1.0:1788843091.588469:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788843091.588516:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933aa00/0xc6b8ac1b0914cbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843091.588528:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab4933aa00/0xc6b8ac1b0914cbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843091.588539:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab4933aa00/0xc6b8ac1b0914cbb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843091.588756:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795652480:0@lo:101: 00000100:00100000:1.0:1788843091.588824:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843091.588964:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795652480 00000100:00100000:0.0:1788843091.588971:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795652480 00000100:00100000:0.0:1788843091.589023:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788843091.589034:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+12:5844:x1875737795652480:12345-0@lo:101: 00010000:00010000:0.0:1788843091.589047:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843091.589060:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab40031c00/0xc6b8ac1b0914cc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914cbb expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.589083:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab40031c00/0xc6b8ac1b0914cc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914cbb expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.589094:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab40031c00/0xc6b8ac1b0914cc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914cbb expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.589103:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab40031c00, rc 0) 00000100:00100000:0.0:1788843091.589139:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+13:5844:x1875737795652480:12345-0@lo:101: Request processed in 108us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843091.589146:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788843091.589872:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd180 going to sleep for 11 seconds 00000100:00100000:1.0:1788843091.589901:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795652480:0@lo:101: 00010000:00010000:1.0:1788843091.589919:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab4933aa00/0xc6b8ac1b0914cbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cc2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843091.589930:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab4933aa00/0xc6b8ac1b0914cbb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914cc2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843091.589992:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795652608:0@lo:501: 00000100:00100000:1.0:1788843091.590032:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843091.596155:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795652608 00000100:00100000:3.0:1788843091.596171:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795652608 00000100:00100000:3.0:1788843091.596240:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788843091.596250:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+13:5844:x1875737795652608:12345-0@lo:501: 00000100:00100000:1.0:1788843091.597235:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843091.598524:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+13:5844:x1875737795652608:12345-0@lo:501: Request processed in 2269us (8485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843091.598535:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788843091.598934:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795652608:0@lo:501: 00000100:00100000:1.0:1788843091.598998:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795652736:0@lo:503: 00000100:00100000:1.0:1788843091.599117:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843091.599200:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788843091.599285:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795652736 00000100:00100000:0.0:1788843091.599292:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795652736 00000100:00100000:0.0:1788843091.599375:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788843091.599384:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+13:5844:x1875737795652736:12345-0@lo:503: 00000100:00100000:0.0:1788843091.601130:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+13:5844:x1875737795652736:12345-0@lo:503: Request processed in 1740us (2006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843091.601148:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788843091.603006:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795652736:0@lo:503: 00000100:00100000:2.0:1788843091.604037:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8468:1875737795652864:0@lo:502: 00000100:00100000:2.0:1788843091.604126:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843091.604171:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab5070dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843091.604248:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795652864 00000100:00100000:3.0:1788843091.604255:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795652864 00000100:00100000:3.0:1788843091.604302:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788843091.604311:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+13:8468:x1875737795652864:12345-0@lo:502: 00000100:00100000:3.0:1788843091.604811:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+13:8468:x1875737795652864:12345-0@lo:502: Request processed in 501us (684us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843091.604817:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788843091.604984:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8468:1875737795652864:0@lo:502: 00000100:00100000:2.0:1788843091.605042:0:8468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8468:1875737795652992:0@lo:502: 00000100:00100000:2.0:1788843091.605083:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843091.605118:0:8468:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69916a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788843091.605173:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795652992 00000100:00100000:0.0:1788843091.605179:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795652992 00000100:00100000:0.0:1788843091.605247:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788843091.605255:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+13:8468:x1875737795652992:12345-0@lo:502: 00000100:00100000:0.0:1788843091.605648:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+13:8468:x1875737795652992:12345-0@lo:502: Request processed in 392us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843091.605655:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788843091.605802:0:8468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8468:1875737795652992:0@lo:502: 00000040:00080000:2.0:1788843091.605826:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788843091.605965:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788843091.605981:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788843091.605992:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933aa00/0xc6b8ac1b0914cbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cc2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843091.606003:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933aa00/0xc6b8ac1b0914cbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cc2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843091.606012:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788843091.606015:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788843091.606018:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788843091.606044:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a400/0xc6b8ac1b0914cc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843091.606053:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab4933a400/0xc6b8ac1b0914cc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843091.606062:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab4933a400/0xc6b8ac1b0914cc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843091.606149:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795653120:0@lo:101: 00000100:00100000:1.0:1788843091.606188:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843091.606293:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795653120 00000100:00100000:3.0:1788843091.606299:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795653120 00000100:00100000:3.0:1788843091.606335:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788843091.606428:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+13:5844:x1875737795653120:12345-0@lo:101: 00010000:00010000:3.0:1788843091.606439:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843091.606452:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914cd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914cc9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843091.606474:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd180 going to sleep for 11 seconds 00010000:00010000:3.0:1788843091.606486:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914cd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914cc9 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843091.606585:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914cd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914cc9 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843091.606595:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41533200, rc 0) 00000100:00100000:3.0:1788843091.606642:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+14:5844:x1875737795653120:12345-0@lo:101: Request processed in 215us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843091.606648:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788843091.607180:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795653120:0@lo:101: 00010000:00010000:1.0:1788843091.607207:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab4933a400/0xc6b8ac1b0914cc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cd0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843091.607217:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab4933a400/0xc6b8ac1b0914cc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914cd0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843091.607573:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795653248:0@lo:501: 00000100:00100000:1.0:1788843091.607627:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843091.607660:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd180 going to sleep for 11 seconds 00000100:00100000:0.0:1788843091.607672:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795653248 00000100:00100000:0.0:1788843091.607677:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795653248 00000100:00100000:0.0:1788843091.607761:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788843091.607768:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+14:5844:x1875737795653248:12345-0@lo:501: 00000100:00100000:0.0:1788843091.608011:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+14:5844:x1875737795653248:12345-0@lo:501: Request processed in 239us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843091.608018:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788843091.608084:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795653248:0@lo:501: 00000100:00100000:1.0:1788843091.608110:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795653376:0@lo:503: 00000100:00100000:1.0:1788843091.608144:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843091.608598:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843091.608782:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795653376 00000100:00100000:3.0:1788843091.608787:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795653376 00000100:00100000:3.0:1788843091.608817:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788843091.608825:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+14:5844:x1875737795653376:12345-0@lo:503: 00000100:00100000:3.0:1788843091.609211:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+14:5844:x1875737795653376:12345-0@lo:503: Request processed in 385us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843091.609218:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788843091.609809:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795653376:0@lo:503: 00000100:00100000:1.0:1788843091.610858:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8469:1875737795653504:0@lo:502: 00000100:00100000:1.0:1788843091.610927:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843091.610957:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd000 going to sleep for 11 seconds 00000100:00100000:0.0:1788843091.611023:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795653504 00000100:00100000:0.0:1788843091.611030:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795653504 00000100:00100000:0.0:1788843091.611102:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788843091.611111:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+14:8469:x1875737795653504:12345-0@lo:502: 00000100:00100000:0.0:1788843091.611375:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+14:8469:x1875737795653504:12345-0@lo:502: Request processed in 264us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843091.611383:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788843091.611460:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8469:1875737795653504:0@lo:502: 00000020:01000000:1.0:1788843091.611488:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843091.611496:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843091.611499:0:8469:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788843091.611503:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788843091.611524:0:8469:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8469:1875737795653632:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843091.611556:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843091.612204:0:8469:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd000 going to sleep for 11 seconds 00000100:00100000:2.0:1788843091.612686:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795653632 00000100:00100000:2.0:1788843091.612693:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795653632 00000100:00100000:2.0:1788843091.612738:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788843091.612746:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+14:8469:x1875737795653632:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843091.612960:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+14:8469:x1875737795653632:12345-0@lo:502:llog_process_th.0 Request processed in 214us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843091.612967:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788843091.613105:0:8469:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8469:1875737795653632:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843091.613134:0:8469:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843091.613140:0:8469:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843091.613142:0:8469:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788843091.613151:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1788843091.613476:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1788843091.613492:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788843091.613503:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a400/0xc6b8ac1b0914cc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cd0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843091.613515:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933a400/0xc6b8ac1b0914cc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cd0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843091.613524:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788843091.613527:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dab7395d800 from 39 10000000:01000000:3.0:1788843091.613530:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788843091.613563:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41533e00/0xc6b8ac1b0914cd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843091.613571:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab41533e00/0xc6b8ac1b0914cd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843091.613579:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab41533e00/0xc6b8ac1b0914cd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843091.613607:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c183b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795653760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843091.613642:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843091.613666:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41ada9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843091.613770:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795653760 00000100:00100000:0.0:1788843091.613775:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795653760 00000100:00100000:0.0:1788843091.613804:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788843091.613809:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+14:5844:x1875737795653760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843091.613816:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843091.613825:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab40030400/0xc6b8ac1b0914cde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914cd7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.613852:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab40030400/0xc6b8ac1b0914cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914cd7 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.613866:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab40030400/0xc6b8ac1b0914cde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914cd7 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.613874:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab40030400, rc 0) 00000100:00100000:0.0:1788843091.613906:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+15:5844:x1875737795653760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843091.613911:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788843091.613983:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c183b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795653760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843091.613996:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab41533e00/0xc6b8ac1b0914cd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cde expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843091.614005:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab41533e00/0xc6b8ac1b0914cd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914cde expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843091.614049:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c183b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795653888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843091.614153:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843091.614179:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41ada9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843091.614222:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795653888 00000100:00100000:3.0:1788843091.614227:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795653888 00000100:00100000:3.0:1788843091.614257:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788843091.614264:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+15:5844:x1875737795653888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843091.614638:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+15:5844:x1875737795653888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 373us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843091.614646:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788843091.614684:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c183b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795653888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843091.614768:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795654016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843091.614810:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843091.614893:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab5070d600 going to sleep for 11 seconds 00000100:00100000:0.0:1788843091.615102:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795654016 00000100:00100000:0.0:1788843091.615106:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795654016 00000100:00100000:0.0:1788843091.615138:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788843091.615146:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+15:5844:x1875737795654016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843091.615307:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+15:5844:x1875737795654016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843091.615315:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788843091.615464:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795654016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843091.615893:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8470:1875737795654144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843091.615933:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843091.615993:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab5070dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788843091.616020:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795654144 00000100:00100000:0.0:1788843091.616024:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795654144 00000100:00100000:0.0:1788843091.616057:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788843091.616072:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+15:8470:x1875737795654144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843091.616328:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+15:8470:x1875737795654144:12345-0@lo:502:llog_process_th.0 Request processed in 255us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843091.616488:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8470:1875737795654144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843091.616529:0:8470:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8470:1875737795654272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843091.616565:0:8470:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843091.616622:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788843091.616638:0:8470:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab5070dd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788843091.616645:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795654272 00000100:00100000:0.0:1788843091.616649:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795654272 00000100:00100000:0.0:1788843091.616723:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788843091.616730:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+15:8470:x1875737795654272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843091.616894:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+15:8470:x1875737795654272:12345-0@lo:502:llog_process_th.0 Request processed in 165us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843091.616901:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788843091.617003:0:8470:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8470:1875737795654272:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788843091.617022:0:8470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788843091.617210:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788843091.617297:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788843091.617310:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41533e00/0xc6b8ac1b0914cd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cde expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.617321:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab41533e00/0xc6b8ac1b0914cd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cde expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843091.617579:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788843091.617582:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788843091.617723:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788843091.617750:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab40031a00/0xc6b8ac1b0914ce5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.617758:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab40031a00/0xc6b8ac1b0914ce5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.617766:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab40031a00/0xc6b8ac1b0914ce5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843091.617789:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795654400:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843091.617826:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843091.617893:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4939a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788843091.617924:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795654400 00000100:00100000:2.0:1788843091.617935:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795654400 00000100:00100000:2.0:1788843091.617969:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788843091.617976:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+15:5844:x1875737795654400:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843091.617986:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843091.617997:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff89a00/0xc6b8ac1b0914cec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914ce5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843091.618017:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff89a00/0xc6b8ac1b0914cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914ce5 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843091.618027:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff89a00/0xc6b8ac1b0914cec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914ce5 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843091.618035:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89a00, rc 0) 00000100:00100000:2.0:1788843091.618115:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+16:5844:x1875737795654400:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843091.618122:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788843091.618191:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795654400:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843091.618200:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab40031a00/0xc6b8ac1b0914ce5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.618206:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab40031a00/0xc6b8ac1b0914ce5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914cec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843091.618463:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795654528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843091.618488:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843091.618510:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4939a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788843091.618525:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795654528 00000100:00100000:2.0:1788843091.618529:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795654528 00000100:00100000:2.0:1788843091.618557:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788843091.618564:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+16:5844:x1875737795654528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843091.618860:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+16:5844:x1875737795654528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843091.618867:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788843091.618917:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795654528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843091.618939:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795654656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843091.618964:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843091.619000:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4939a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788843091.619020:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795654656 00000100:00100000:2.0:1788843091.619023:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795654656 00000100:00100000:2.0:1788843091.619066:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788843091.619071:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+16:5844:x1875737795654656:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843091.619216:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+16:5844:x1875737795654656:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843091.619229:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788843091.619585:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795654656:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843091.620108:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8471:1875737795654784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843091.620151:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843091.620184:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4939a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788843091.620237:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795654784 00000100:00100000:2.0:1788843091.620243:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795654784 00000100:00100000:2.0:1788843091.620278:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788843091.620286:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+16:8471:x1875737795654784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843091.620881:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+16:8471:x1875737795654784:12345-0@lo:502:llog_process_th.0 Request processed in 594us (727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843091.620889:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788843091.620947:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8471:1875737795654784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843091.620967:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843091.620978:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843091.620980:0:8471:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788843091.620984:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788843091.621007:0:8471:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8471:1875737795654912:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843091.621040:0:8471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843091.621096:0:8471:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4939a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788843091.621126:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795654912 00000100:00100000:2.0:1788843091.621130:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795654912 00000100:00100000:2.0:1788843091.621163:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788843091.621171:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+16:8471:x1875737795654912:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843091.621325:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+16:8471:x1875737795654912:12345-0@lo:502:llog_process_th.0 Request processed in 154us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843091.621365:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788843091.621676:0:8471:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8471:1875737795654912:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843091.621854:0:8471:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843091.621858:0:8471:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843091.621860:0:8471:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788843091.621863:0:8471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788843091.621998:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788843091.622013:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788843091.622022:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab40031a00/0xc6b8ac1b0914ce5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843091.622036:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab40031a00/0xc6b8ac1b0914ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843091.622046:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788843091.622048:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dab71a20000 from 39 10000000:01000000:2.0:1788843091.622058:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788843091.622084:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88800/0xc6b8ac1b0914cf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843091.622093:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88800/0xc6b8ac1b0914cf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843091.622101:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88800/0xc6b8ac1b0914cf3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843091.622119:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795655040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788843091.622156:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843091.622227:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4937c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843091.622259:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795655040 00000100:00100000:0.0:1788843091.622264:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795655040 00000100:00100000:0.0:1788843091.622322:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788843091.622452:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+16:5844:x1875737795655040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843091.622464:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843091.622474:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab40030200/0xc6b8ac1b0914cfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914cf3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.622493:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab40030200/0xc6b8ac1b0914cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914cf3 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.622504:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab40030200/0xc6b8ac1b0914cfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914cf3 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.622513:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab40030200, rc 0) 00000100:00100000:0.0:1788843091.622564:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795655040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 233us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843091.622570:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788843091.622646:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795655040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843091.622666:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88800/0xc6b8ac1b0914cf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843091.622676:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88800/0xc6b8ac1b0914cf3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914cfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843091.622723:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795655168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843091.622749:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843091.622886:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843091.622935:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795655168 00000100:00100000:2.0:1788843091.622938:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795655168 00000100:00100000:2.0:1788843091.622953:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788843091.622957:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795655168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843091.623171:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795655168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 212us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843091.623178:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788843091.623248:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795655168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843091.623273:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795655296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843091.623318:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843091.623461:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795655296 00000100:00100000:1.0:1788843091.623463:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd900 going to sleep for 11 seconds 00000100:00100000:3.0:1788843091.623466:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795655296 00000100:00100000:2.0:1788843091.623500:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788843091.623508:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795655296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843091.623686:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795655296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843091.623693:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788843091.623863:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795655296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843091.624243:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8472:1875737795655424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843091.624284:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843091.624304:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843091.624449:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795655424 00000100:00100000:0.0:1788843091.624455:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795655424 00000100:00100000:0.0:1788843091.624483:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788843091.624490:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+17:8472:x1875737795655424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843091.624851:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+17:8472:x1875737795655424:12345-0@lo:502:llog_process_th.0 Request processed in 360us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843091.624858:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788843091.624879:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8472:1875737795655424:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843091.624919:0:8472:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8472:1875737795655552:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843091.624948:0:8472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843091.625004:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795655552 00000100:00100000:3.0:1788843091.625009:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795655552 00000100:00100000:1.0:1788843091.625017:0:8472:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843091.625039:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788843091.625046:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+17:8472:x1875737795655552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843091.625188:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+17:8472:x1875737795655552:12345-0@lo:502:llog_process_th.0 Request processed in 142us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843091.625195:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788843091.625199:0:8472:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8472:1875737795655552:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788843091.625214:0:8472:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788843091.625490:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1788843091.625754:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788843091.625765:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88800/0xc6b8ac1b0914cf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843091.625785:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88800/0xc6b8ac1b0914cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843091.625795:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788843091.625798:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788843091.625802:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788843091.625827:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89400/0xc6b8ac1b0914d01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843091.625846:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89400/0xc6b8ac1b0914d01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843091.625855:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89400/0xc6b8ac1b0914d01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843091.625871:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795655680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788843091.625912:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843091.626062:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4937c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843091.626097:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795655680 00000100:00100000:0.0:1788843091.626103:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795655680 00000100:00100000:0.0:1788843091.626173:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788843091.626181:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795655680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843091.626193:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843091.626206:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab40031600/0xc6b8ac1b0914d08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914d01 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.626232:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab40031600/0xc6b8ac1b0914d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d01 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.626242:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab40031600/0xc6b8ac1b0914d08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d01 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843091.626251:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab40031600, rc 0) 00000100:00100000:0.0:1788843091.626410:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795655680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843091.626417:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788843091.626846:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795655680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843091.626871:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89400/0xc6b8ac1b0914d01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843091.626880:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89400/0xc6b8ac1b0914d01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914d08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843091.626932:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795655808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843091.626962:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843091.626983:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843091.627017:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795655808 00000100:00100000:0.0:1788843091.627022:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795655808 00000100:00100000:0.0:1788843091.627079:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788843091.627087:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795655808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843091.627409:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795655808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843091.627416:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788843091.627481:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795655808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843091.627519:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795655936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843091.627556:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843091.630633:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788843091.631092:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795655936 00000100:00100000:2.0:1788843091.631103:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795655936 00000100:00100000:2.0:1788843091.631412:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788843091.631425:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795655936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843091.631668:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795655936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (4110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843091.631676:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788843091.631760:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795655936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843091.632675:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8473:1875737795656064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843091.633098:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843091.633153:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab493683c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843091.633243:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795656064 00000100:00100000:3.0:1788843091.633250:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795656064 00000100:00100000:3.0:1788843091.633289:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788843091.633298:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+18:8473:x1875737795656064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843091.633772:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+18:8473:x1875737795656064:12345-0@lo:502:llog_process_th.0 Request processed in 474us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843091.633780:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788843091.634361:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8473:1875737795656064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843091.634397:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843091.634407:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843091.634409:0:8473:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788843091.634415:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788843091.634451:0:8473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8473:1875737795656192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843091.634506:0:8473:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843091.634542:0:8473:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4939a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843091.634591:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795656192 00000100:00100000:2.0:1788843091.634598:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795656192 00000100:00100000:2.0:1788843091.634638:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788843091.634647:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+18:8473:x1875737795656192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843091.634829:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+18:8473:x1875737795656192:12345-0@lo:502:llog_process_th.0 Request processed in 183us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843091.634848:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788843091.634947:0:8473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8473:1875737795656192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843091.634968:0:8473:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843091.634973:0:8473:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843091.634974:0:8473:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788843091.634978:0:8473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788843091.635227:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1788843091.635246:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788843091.635256:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89400/0xc6b8ac1b0914d01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843091.635267:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89400/0xc6b8ac1b0914d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843091.635276:0:5844:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788843091.635279:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dab600719b8 from 1 10000000:01000000:1.0:1788843091.635281:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788843091.635303:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a200/0xc6b8ac1b0914d0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843091.635333:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab4933a200/0xc6b8ac1b0914d0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843091.635372:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab4933a200/0xc6b8ac1b0914d0f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843091.635389:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795656320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788843091.635423:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843091.635442:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd780 going to sleep for 11 seconds 00000100:00100000:2.0:1788843091.635672:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795656320 00000100:00100000:2.0:1788843091.635679:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795656320 00000100:00100000:2.0:1788843091.635714:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788843091.635721:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795656320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843091.635731:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843091.635743:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff89600/0xc6b8ac1b0914d16 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914d0f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843091.635766:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff89600/0xc6b8ac1b0914d16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d0f expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843091.635776:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff89600/0xc6b8ac1b0914d16 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d0f expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843091.635786:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89600, rc 0) 00000100:00100000:2.0:1788843091.635846:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795656320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843091.635853:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788843091.635942:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795656320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843091.635954:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab4933a200/0xc6b8ac1b0914d0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843091.635963:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab4933a200/0xc6b8ac1b0914d0f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914d16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843091.636007:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795656448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843091.636031:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843091.636061:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843091.636422:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795656448 00000100:00100000:0.0:1788843091.636429:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795656448 00000100:00100000:0.0:1788843091.636469:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788843091.636476:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795656448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843091.636719:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795656448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (686us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788843091.636727:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788843091.636753:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795656448:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788843091.636778:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788843091.636786:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a200/0xc6b8ac1b0914d0f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843091.636793:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933a200/0xc6b8ac1b0914d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843091.716913:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843092.112130:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843092.112169:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843092.112244:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843092.112330:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775707648 00000100:00100000:2.0:1788843092.112380:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775707264 00000100:00100000:0.0:1788843092.112383:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775707648 00000100:00100000:2.0:1788843092.112386:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775707264 00000100:00100000:0.0:1788843092.112456:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:0.0:1788843092.112469:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2357:x1875737775707648:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843092.112559:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51455880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2357:x1875737775707648:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 92us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843092.112568:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00080000:1.0:1788843092.112752:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843092.112908:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775707392 00000100:00100000:3.0:1788843092.112914:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775707392 00000100:00100000:2.0:1788843092.112916:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 169 00000100:00100000:2.0:1788843092.112928:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2356:x1875737775707264:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843092.112967:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2356:x1875737775707264:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 42us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843092.112975:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 169 00000100:00080000:0.0:1788843092.113088:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843092.113374:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:3.0:1788843092.113383:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2357:x1875737775707392:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843092.113446:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51454700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2357:x1875737775707392:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 65us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843092.113453:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:1.0:1788843092.113653:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843092.113757:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775707520 00000100:00100000:3.0:1788843092.113762:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775707520 00000100:00100000:3.0:1788843092.113804:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:3.0:1788843092.113811:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2356:x1875737775707520:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843092.113854:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2356:x1875737775707520:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 43us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843092.113868:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00080000:1.0:1788843092.113924:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843092.292582:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795656576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843092.292674:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843092.292817:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795656576 00000100:00100000:1.0:1788843092.292826:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795656576 00000100:00080000:3.0:1788843092.292876:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843092.292910:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788843092.292917:0:6697:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:1.0:1788843092.292923:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795656576:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843092.292933:0:6697:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:1.0:1788843092.292966:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843092.296649:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795656576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3719us (3964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843092.296665:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788843092.296776:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7bcae680 x1875737795656576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843092.296804:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795656576:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788843092.742752:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788843093.231452:0:8511:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc1220b1d0 20000000:00000080:2.0:1788843093.231478:0:8511:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dab51a29800 uarg=0000000000000000 20000000:01000000:2.0:1788843093.231524:0:8511:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788843093.231530:0:8511:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788843093.231536:0:8511:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788843093.234266:0:8512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788843093.234517:0:8511:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788843093.244850:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788843093.244920:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788843093.244980:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788843093.245003:0:8511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788843093.245020:0:8511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dab7ff88a00/0xc6b8ac1b0914d1d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843093.245037:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab40031400/0xc6b8ac1b0914a92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914a8b expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843093.245045:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab40031800/0xc6b8ac1b0914af4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914aed expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843093.245057:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914bbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914bb8 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843093.245068:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914c7c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708474c expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843093.245085:0:8511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dab7ff88a00/0xc6b8ac1b0914d1d lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843093.245123:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914c7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708474c expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843093.245140:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914c7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708474c expref: 9 pid: 5840 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843093.245155:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875737795656704:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843093.245279:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914bbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914bb8 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843093.245287:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914bbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914bb8 expref: 18 pid: 5841 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843093.245296:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875737795656832:0@lo:104: 00000100:00100000:2.0:1788843093.245336:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788843093.245423:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab40031800/0xc6b8ac1b0914af4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914aed expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843093.245432:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab40031800/0xc6b8ac1b0914af4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914aed expref: 18 pid: 5840 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843093.245440:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875737795656960:0@lo:104: 00000100:00100000:2.0:1788843093.245465:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843093.245495:0:6717:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788843093.245507:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795656832 00000100:00100000:0.0:1788843093.245514:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795656832 00000100:00100000:0.0:1788843093.245563:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795656960 00000100:00100000:0.0:1788843093.245566:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795656960 00000100:00100000:0.0:1788843093.245580:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843093.245590:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28cf63da-daee-485f-b466-4ec68876f732+4:8511:x1875737795656832:12345-0@lo:104: 00010000:00010000:0.0:1788843093.245602:0:6717:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab40031000/0xc6b8ac1b0914bb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914bbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843093.245659:0:6717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788843093.245666:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28cf63da-daee-485f-b466-4ec68876f732+4:8511:x1875737795656832:12345-0@lo:104: Request processed in 78us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843093.245672:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843093.245689:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788843093.245695:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28cf63da-daee-485f-b466-4ec68876f732+3:8511:x1875737795656960:12345-0@lo:104: 00010000:00010000:0.0:1788843093.245711:0:6717:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab40030000/0xc6b8ac1b0914aed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914af4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843093.245745:0:6717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788843093.245750:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28cf63da-daee-485f-b466-4ec68876f732+3:8511:x1875737795656960:12345-0@lo:104: Request processed in 55us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843093.245756:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1788843093.245790:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843093.245796:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab40031000/0xc6b8ac1b0914bb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914bbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843093.245803:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40031000 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843093.245806:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab40031000/0xc6b8ac1b0914bb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914bbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843093.245815:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab40031000/0xc6b8ac1b0914bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914bbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843093.245821:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab40031000/0xc6b8ac1b0914bb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914bbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843093.245835:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788843093.245859:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab40031000/0xc6b8ac1b0914bb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914bbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843093.245865:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843093.245883:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab40031000/0xc6b8ac1b0914bb8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914bbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843093.245890:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab40031000/0xc6b8ac1b0914bb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914bbf expref: -99 pid: 7631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843093.245911:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843093.245914:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab40030000/0xc6b8ac1b0914aed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914af4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843093.245920:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40030000 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843093.245922:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab40030000/0xc6b8ac1b0914aed lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914af4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843093.245928:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab40030000/0xc6b8ac1b0914aed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914af4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843093.245934:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab40030000/0xc6b8ac1b0914aed lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914af4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843093.245939:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788843093.245953:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab40030000/0xc6b8ac1b0914aed lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914af4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843093.245958:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843093.245971:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab40030000/0xc6b8ac1b0914aed lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914af4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843093.245978:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab40030000/0xc6b8ac1b0914aed lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914af4 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843093.245986:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843093.245989:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843093.245991:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843093.246000:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843093.246018:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795657088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843093.246048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788843093.246155:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843093.246175:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795657216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843093.249250:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795657088 00000100:00100000:2.0:1788843093.249265:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795657088 00010000:00010000:2.0:1788843093.249329:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914bbf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914bb8 expref: 19 pid: 5841 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843093.249395:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788843093.249406:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28cf63da-daee-485f-b466-4ec68876f732+19:3304:x1875737795657088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843093.249424:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843093.249429:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914bbf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914bb8 expref: 19 pid: 5841 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843093.249441:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914bbf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914bb8 expref: 19 pid: 5841 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843093.249463:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843093.249694:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843093.249812:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795657216 00000100:00100000:3.0:1788843093.249817:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795657216 00010000:00010000:3.0:1788843093.249845:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab40031800/0xc6b8ac1b0914af4 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914aed expref: 20 pid: 5840 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843093.249877:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788843093.249884:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51454380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+20:3306:x1875737795657216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843093.249894:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843093.249898:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab40031800/0xc6b8ac1b0914af4 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914aed expref: 20 pid: 5840 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843093.249907:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab40031800/0xc6b8ac1b0914af4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914aed expref: 20 pid: 5840 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843093.249917:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843093.249972:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51454380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+20:3306:x1875737795657216:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843093.249979:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788843093.250018:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795657216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843093.253313:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00010000:00010000:1.0:1788843093.253430:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab40031400/0xc6b8ac1b0914a92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914a8b expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843093.253446:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab40031400/0xc6b8ac1b0914a92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a8b expref: 19 pid: 5841 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843093.253461:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51456300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875737795657344:0@lo:104: 00000100:00100000:1.0:1788843093.253505:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843093.253549:0:8511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4737dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843093.253589:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875737795656704:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843093.253601:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab821c5400/0xc6b8ac1b0914bbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914bb8 expref: 19 pid: 5841 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843093.253616:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875737795656832:0@lo:104: 00010000:00010000:1.0:1788843093.253624:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab40031800/0xc6b8ac1b0914af4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914aed expref: 18 pid: 5840 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843093.253632:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875737795656960:0@lo:104: 00000100:00100000:3.0:1788843093.253820:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775707776 00000100:00100000:3.0:1788843093.253836:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775707776 00010000:00010000:3.0:1788843093.253869:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914c7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708474c expref: 10 pid: 5840 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843093.253907:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:3.0:1788843093.253924:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51457480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2358:x1875737775707776:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843093.253938:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843093.253945:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914c7c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708474c expref: 10 pid: 5840 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843093.253957:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914c7c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708474c expref: 10 pid: 5840 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843093.253973:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914c7c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708474c expref: 10 pid: 5840 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843093.253986:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843093.254041:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51457480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+9:2358:x1875737775707776:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 118us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843093.254049:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:0.0:1788843093.255624:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795657344 00000100:00100000:0.0:1788843093.255639:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795657344 00000100:00100000:2.0:1788843093.255981:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28cf63da-daee-485f-b466-4ec68876f732+17:3304:x1875737795657088:12345-0@lo:103:ldlm_bl.0 Request processed in 6573us (9927us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843093.255992:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788843093.257045:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795657088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843093.257095:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788843093.257118:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51455f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28cf63da-daee-485f-b466-4ec68876f732+3:8511:x1875737795657344:12345-0@lo:104: 00010000:00010000:0.0:1788843093.257141:0:6717:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0914a8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914a92 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843093.257231:0:6717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788843093.257237:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51456300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875737795657344:0@lo:104: 00000100:00100000:0.0:1788843093.257238:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51455f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28cf63da-daee-485f-b466-4ec68876f732+3:8511:x1875737795657344:12345-0@lo:104: Request processed in 131us (3731us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843093.257244:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788843093.257264:0:8511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dab7ff88a00/0xc6b8ac1b0914d1d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843093.257306:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843093.257313:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0914a8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914a92 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843093.257321:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4400 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:2.0:1788843093.257324:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0914a8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914a92 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843093.257332:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0914a8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914a92 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843093.257357:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0914a8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914a92 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843093.257365:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788843093.257535:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0914a8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914a92 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843093.257542:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788843093.257603:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795657472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843093.257645:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843093.257726:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795657472 00000100:00100000:3.0:1788843093.257734:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795657472 00010000:00010000:3.0:1788843093.257761:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab40031400/0xc6b8ac1b0914a92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a8b expref: 17 pid: 5841 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843093.257789:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788843093.257796:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+17:3307:x1875737795657472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843093.257810:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843093.257815:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab40031400/0xc6b8ac1b0914a92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a8b expref: 17 pid: 5841 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843093.257838:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab40031400/0xc6b8ac1b0914a92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914a8b expref: 17 pid: 5841 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843093.257865:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab40031400/0xc6b8ac1b0914a92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914a8b expref: 17 pid: 5841 timeout: 367 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843093.257884:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dab7ff88a00/0xc6b8ac1b0914d1d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843093.257893:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff88a00/0xc6b8ac1b0914d1d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843093.257909:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab7ff88a00/0xc6b8ac1b0914d1d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843093.257917:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab7ff88a00/0xc6b8ac1b0914d1d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843093.257924:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dab7ff88a00/0xc6b8ac1b0914d1d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843093.257929:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dab7ff88a00/0xc6b8ac1b0914d1d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843093.257934:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843093.257949:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dab7ff88a00/0xc6b8ac1b0914d1d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843093.257957:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dab7ff88a00/0xc6b8ac1b0914d1d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843093.257972:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dab7ff88a00/0xc6b8ac1b0914d1d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843093.257990:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843093.259198:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0914a8b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914a92 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843093.259213:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0914a8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914a92 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843093.259232:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843093.259234:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843093.259236:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843093.259251:0:8511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dab7ff88a00/0xc6b8ac1b0914d1d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843093.259268:0:8511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dab7ff88a00/0xc6b8ac1b0914d1d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843093.259272:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7ff88a00/0xc6b8ac1b0914d1d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843093.264396:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+16:3307:x1875737795657472:12345-0@lo:103:ldlm_bl.0 Request processed in 6592us (6742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843093.264410:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788843093.270873:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795657472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843093.319529:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795657856:0@lo:400:kworker.0 00000100:00100000:3.0:1788843093.319603:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843093.319664:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843093.319671:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795657984:0@lo:400:kworker.0 00000100:00100000:3.0:1788843093.319697:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843093.319786:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795657728:0@lo:400:kworker.0 00000100:00100000:2.0:1788843093.319817:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843093.319871:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788843093.319878:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795657600:0@lo:400:kworker.0 00000100:00100000:2.0:1788843093.319902:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843093.319924:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795658112:0@lo:400:kworker.0 00000100:00100000:2.0:1788843093.319946:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843093.319980:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795657984 00000100:00100000:2.0:1788843093.319988:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795657984 00000100:00100000:2.0:1788843093.320042:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795657728 00000100:00100000:2.0:1788843093.320046:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795657728 00000100:00100000:2.0:1788843093.320058:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795657600 00000100:00100000:2.0:1788843093.320061:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795657600 00000100:00100000:2.0:1788843093.320074:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788843093.320083:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795657984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843093.320139:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795657984:12345-0@lo:400:kworker.0 Request processed in 57us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843093.320147:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788843093.320165:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788843093.320172:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795657728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843093.320208:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795657728:12345-0@lo:400:kworker.0 Request processed in 36us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843093.320214:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788843093.320226:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788843093.320232:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795657600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843093.320279:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795657600:12345-0@lo:400:kworker.0 Request processed in 47us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843093.320285:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788843093.320307:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795657856 00000100:00100000:2.0:1788843093.320311:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795657856 00000100:00100000:2.0:1788843093.320333:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795658112 00000100:00100000:2.0:1788843093.320336:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795658112 00000100:00100000:2.0:1788843093.320394:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788843093.320401:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795657856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843093.320435:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795657856:12345-0@lo:400:kworker.0 Request processed in 35us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843093.320441:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788843093.320452:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788843093.320459:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795658112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843093.320488:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795658112:12345-0@lo:400:kworker.0 Request processed in 30us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843093.320494:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788843093.320510:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788843093.320515:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843093.320561:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795657600:0@lo:400:kworker.0 00010000:00080000:2.0:1788843093.320578:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7c180380 x1875737795658112/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843093.320588:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795658112:0@lo:400:kworker.0 00000100:00100000:2.0:1788843093.320598:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795657728:0@lo:400:kworker.0 00000100:00100000:2.0:1788843093.320633:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795657984:0@lo:400:kworker.0 00010000:00080000:2.0:1788843093.320653:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7c182300 x1875737795657856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843109 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843093.320663:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795657856:0@lo:400:kworker.0 00010000:00010000:2.0:1788843093.768050:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843093.829686:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843093.829712:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795658240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843093.829779:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843093.829916:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795658240 00000100:00100000:2.0:1788843093.829926:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795658240 00000100:00100000:2.0:1788843093.829981:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788843093.829991:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795658240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788843093.830025:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788843093.830086:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51455180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795658240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843093.830093:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788843093.830130:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e84ad80 x1875737795658240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843109 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843093.830163:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795658240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843094.545534:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843094.545643:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775707904 00000100:00100000:3.0:1788843094.545654:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775707904 00000100:00100000:3.0:1788843094.545720:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 170 00000100:00100000:3.0:1788843094.545741:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+9:5598:x1875737775707904:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843094.545758:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843094.545783:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab41532e00/0xc6b8ac1b0914d24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c60708478b expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843094.545812:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41532e00/0xc6b8ac1b0914d24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708478b expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843094.545832:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab41532e00/0xc6b8ac1b0914d24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708478b expref: 10 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843094.545842:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41532e00, rc 0) 00000100:00100000:3.0:1788843094.545911:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:5598:x1875737775707904:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 181us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843094.545928:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 170 00000100:00100000:3.0:1788843094.554116:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843094.554194:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775708032 00000100:00100000:0.0:1788843094.554204:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775708032 00000100:00100000:0.0:1788843094.554266:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 171 00000100:00100000:0.0:1788843094.554276:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:5598:x1875737775708032:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843094.554642:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:5598:x1875737775708032:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 364us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843094.554652:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 171 00000100:00100000:3.0:1788843094.560635:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843094.561613:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775708160 00000100:00100000:3.0:1788843094.561627:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775708160 00000100:00100000:3.0:1788843094.561709:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 172 00000100:00100000:3.0:1788843094.561720:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:5598:x1875737775708160:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843094.561991:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:5598:x1875737775708160:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 272us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843094.561998:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 172 00000100:00100000:1.0:1788843094.571593:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843094.571934:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775708288 00000100:00100000:3.0:1788843094.571948:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775708288 00000100:00100000:3.0:1788843094.572037:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 173 00000100:00100000:3.0:1788843094.572048:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:6135:x1875737775708288:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788843094.572293:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:6135:x1875737775708288:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 246us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843094.572301:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 173 00000100:00100000:3.0:1788843094.576948:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843094.577118:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775708416 00000100:00100000:2.0:1788843094.577128:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775708416 00000100:00100000:2.0:1788843094.577175:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 174 00000100:00100000:2.0:1788843094.577185:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:6135:x1875737775708416:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843094.577453:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:6135:x1875737775708416:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 268us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843094.577461:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 174 00010000:00010000:0.0:1788843094.788620:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788843095.236465:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788843095.236472:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab51a7d800 from 4 10000000:01000000:2.0:1788843095.236477:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788843095.236547:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88a00/0xc6b8ac1b0914d2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843095.236561:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88a00/0xc6b8ac1b0914d2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843095.236574:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88a00/0xc6b8ac1b0914d2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843095.236604:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795658368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788843095.236682:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843095.236761:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51597000 going to sleep for 11 seconds 00000100:00100000:3.0:1788843095.236824:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795658368 00000100:00100000:3.0:1788843095.236834:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795658368 00000100:00100000:3.0:1788843095.236903:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788843095.236914:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+16:5844:x1875737795658368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843095.236928:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843095.236942:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914d32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914d2b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843095.236981:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914d32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d2b expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843095.236992:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914d32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d2b expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843095.237002:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41533600, rc 0) 00000100:00100000:3.0:1788843095.237051:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795658368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843095.237058:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788843095.237532:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795658368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843095.237551:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88a00/0xc6b8ac1b0914d2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d32 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843095.237561:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88a00/0xc6b8ac1b0914d2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914d32 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843095.237634:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795658496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843095.237674:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843095.237702:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51597000 going to sleep for 11 seconds 00000100:00100000:1.0:1788843095.237761:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795658496 00000100:00100000:1.0:1788843095.237766:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795658496 00000100:00100000:1.0:1788843095.237797:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788843095.237805:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795658496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843095.238095:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795658496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843095.238102:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788843095.238601:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795658496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843095.238639:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795658624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843095.238685:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843095.238717:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41adaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843095.238774:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795658624 00000100:00100000:2.0:1788843095.238779:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795658624 00000100:00100000:2.0:1788843095.239031:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788843095.239041:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795658624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843095.239243:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795658624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843095.239259:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788843095.239316:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795658624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843095.239575:0:8612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c183100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8612:1875737795658752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843095.239614:0:8612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843095.250961:0:8612:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41adaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843095.252274:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795658752 00000100:00100000:1.0:1788843095.252290:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795658752 00000100:00100000:1.0:1788843095.252951:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1788843095.252965:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+17:8612:x1875737795658752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843095.253636:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+17:8612:x1875737795658752:12345-0@lo:502:llog_process_th.0 Request processed in 673us (14019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843095.253644:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788843095.253861:0:8612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c183100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8612:1875737795658752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788843095.253898:0:8612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843095.253907:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843095.253910:0:8612:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788843095.253916:0:8612:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dab51a7d800 00000020:00000080:2.0:1788843095.253918:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788843095.254028:0:8612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e848000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8612:1875737795658880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843095.254080:0:8612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843095.254135:0:8612:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51597540 going to sleep for 11 seconds 00000100:00100000:1.0:1788843095.254310:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795658880 00000100:00100000:1.0:1788843095.254324:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795658880 00000100:00100000:1.0:1788843095.255492:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788843095.255507:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+17:8612:x1875737795658880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843095.255744:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+17:8612:x1875737795658880:12345-0@lo:502:llog_process_th.0 Request processed in 241us (1664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843095.255751:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788843095.256291:0:8612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e848000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8612:1875737795658880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788843095.256326:0:8612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843095.256335:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843095.256338:0:8612:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788843095.256684:0:8612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788843095.257453:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788843095.257479:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843095.257489:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88a00/0xc6b8ac1b0914d2b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d32 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843095.257501:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88a00/0xc6b8ac1b0914d2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d32 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843095.257512:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788843095.257515:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab7395d800 from 4 10000000:01000000:2.0:1788843095.257517:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788843095.257555:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843095.257577:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843095.257587:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d39 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843095.257608:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e848000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795659008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788843095.257658:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843095.257705:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51597540 going to sleep for 11 seconds 00000100:00100000:1.0:1788843095.257777:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795659008 00000100:00100000:1.0:1788843095.257785:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795659008 00000100:00100000:1.0:1788843095.257949:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788843095.257960:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795659008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843095.257974:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843095.258004:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914d40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914d39 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843095.258030:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914d40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d39 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843095.258041:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914d40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d39 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843095.258049:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933a600, rc 0) 00000100:00100000:1.0:1788843095.258098:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795659008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843095.258105:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788843095.258137:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e848000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795659008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843095.258152:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d40 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843095.258161:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d39 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914d40 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843095.258220:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795659136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843095.258310:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843095.259850:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51401780 going to sleep for 11 seconds 00000100:00100000:2.0:1788843095.259954:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795659136 00000100:00100000:2.0:1788843095.259963:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795659136 00000100:00100000:2.0:1788843095.260091:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788843095.260103:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795659136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843095.263164:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795659136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3053us (4841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843095.263181:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788843095.264068:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd43100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795659136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843095.264145:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795659264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843095.264926:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843095.265330:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51597240 going to sleep for 11 seconds 00000100:00100000:1.0:1788843095.265559:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795659264 00000100:00100000:1.0:1788843095.265570:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795659264 00000100:00100000:1.0:1788843095.265767:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788843095.265779:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795659264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843095.267574:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795659264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1792us (2644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843095.267762:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795659264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843095.268319:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788843095.269115:0:8615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8615:1875737795659392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843095.269217:0:8615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843095.269367:0:8615:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51597a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843095.269961:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795659392 00000100:00100000:1.0:1788843095.269971:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795659392 00000100:00100000:1.0:1788843095.270385:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788843095.270395:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+18:8615:x1875737795659392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843095.271682:0:8615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8615:1875737795659392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788843095.271727:0:8615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843095.271737:0:8615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843095.271740:0:8615:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788843095.271746:0:8615:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dab7395d800 00000020:00000080:2.0:1788843095.271749:0:8615:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788843095.271865:0:8615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8615:1875737795659520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843095.271922:0:8615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843095.271970:0:8615:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51597a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843095.272056:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+18:8615:x1875737795659392:12345-0@lo:502:llog_process_th.0 Request processed in 1030us (2207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843095.272068:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788843095.272109:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795659520 00000100:00100000:1.0:1788843095.272117:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795659520 00000100:00100000:1.0:1788843095.272159:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788843095.272169:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:8615:x1875737795659520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843095.272793:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:8615:x1875737795659520:12345-0@lo:502:llog_process_th.0 Request processed in 624us (870us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843095.272800:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788843095.273373:0:8615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8615:1875737795659520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788843095.273407:0:8615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843095.273414:0:8615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843095.273416:0:8615:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788843095.273420:0:8615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788843095.274699:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788843095.274733:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788843095.274745:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d39 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d40 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843095.274758:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d40 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843095.274770:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788843095.274773:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab71a20000 from 4 10000000:01000000:0.0:1788843095.274776:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843095.274820:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0914d47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843095.274829:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0914d47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843095.274840:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0914d47 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843095.274868:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795659648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843095.274950:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843095.275357:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795659648 00000100:00100000:2.0:1788843095.275364:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795659648 00000100:00100000:2.0:1788843095.275407:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788843095.275416:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795659648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843095.275428:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843095.275442:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b0914d4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914d47 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843095.275470:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b0914d4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d47 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843095.275481:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b0914d4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d47 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843095.275491:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88200, rc 0) 00000100:00100000:2.0:1788843095.275559:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795659648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843095.275566:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788843095.275752:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46745b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788843095.275775:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795659648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843095.275794:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0914d47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d4e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843095.275818:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0914d47 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914d4e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843095.275881:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795659776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843095.275914:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843095.275941:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46745b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843095.276453:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795659776 00000100:00100000:2.0:1788843095.276462:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795659776 00000100:00100000:2.0:1788843095.276499:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788843095.276508:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795659776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843095.276858:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795659776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 350us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843095.276867:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788843095.276975:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795659776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843095.277040:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795659904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843095.277086:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843095.277113:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46745b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843095.277333:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795659904 00000100:00100000:2.0:1788843095.277455:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795659904 00000100:00100000:2.0:1788843095.277540:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788843095.277549:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795659904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843095.277742:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795659904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843095.277749:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788843095.281431:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795659904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843095.291702:0:8618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c182680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8618:1875737795660032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843095.291794:0:8618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843095.291844:0:8618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab473c8300 going to sleep for 11 seconds 00000100:00100000:0.0:1788843095.293465:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795660032 00000100:00100000:0.0:1788843095.293477:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795660032 00000100:00100000:0.0:1788843095.293526:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788843095.293537:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:8618:x1875737795660032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843095.293816:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:8618:x1875737795660032:12345-0@lo:502:llog_process_th.0 Request processed in 271us (2013us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843095.293826:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788843095.293895:0:8618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c182680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8618:1875737795660032:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843095.293933:0:8618:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843095.293943:0:8618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843095.293945:0:8618:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788843095.293952:0:8618:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dab71a20000 00000020:00000080:0.0:1788843095.293954:0:8618:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788843095.294402:0:8618:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8618:1875737795660160:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843095.294456:0:8618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843095.294488:0:8618:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46745600 going to sleep for 11 seconds 00000100:00100000:2.0:1788843095.302092:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795660160 00000100:00100000:2.0:1788843095.302110:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795660160 00000100:00100000:2.0:1788843095.302197:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1788843095.303401:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:8618:x1875737795660160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843095.306123:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:8618:x1875737795660160:12345-0@lo:502:llog_process_th.0 Request processed in 2723us (11656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843095.309608:0:8618:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:8618:1875737795660160:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788843095.309655:0:8618:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843095.309663:0:8618:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843095.309669:0:8618:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788843095.309675:0:8618:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:2.0:1788843095.312496:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000020:01000000:2.0:1788843095.312701:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788843095.312735:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843095.312747:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0914d47 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d4e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843095.312766:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0914d47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d4e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843095.812525:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843096.849910:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843097.233057:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843097.233108:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843097.233138:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843097.233162:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843097.233191:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775708800 00000100:00100000:3.0:1788843097.233200:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775708800 00000100:00100000:3.0:1788843097.233270:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775708928 00000100:00100000:3.0:1788843097.233273:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775708928 00000100:00100000:3.0:1788843097.233297:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:3.0:1788843097.233308:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775708800:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843097.233397:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775708800:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 91us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843097.233404:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:3.0:1788843097.233419:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:3.0:1788843097.233425:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775708928:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843097.233449:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775708928:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 24us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843097.233455:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:3.0:1788843097.233473:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775708672 00000100:00100000:3.0:1788843097.233476:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775708672 00000100:00100000:3.0:1788843097.233513:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:3.0:1788843097.233520:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2359:x1875737775708672:12345-192.168.203.29@tcp:400:kworker.0 00000100:00080000:0.0:1788843097.233706:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788843097.233711:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843097.233713:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843097.234378:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775708544 00000100:00100000:1.0:1788843097.234386:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775708544 00000100:00100000:1.0:1788843097.234436:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 190 00000100:00100000:1.0:1788843097.234445:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2359:x1875737775708544:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843097.240835:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2359:x1875737775708544:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 6378us (7774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843097.240853:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 190 00000100:00100000:3.0:1788843097.241006:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2359:x1875737775708672:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 7484us (7865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843097.241016:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:2.0:1788843097.414814:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843097.414850:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795660288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843097.415325:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843097.417181:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795660288 00000100:00100000:1.0:1788843097.417210:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795660288 00000100:00100000:1.0:1788843097.417293:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788843097.417305:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795660288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843097.417446:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843097.417522:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795660288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 219us (2197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843097.417529:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788843097.417582:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e84bb80 x1875737795660288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843097.417602:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795660288:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788843097.418017:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788843097.864707:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843098.438898:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795660416:0@lo:400:kworker.0 00000100:00100000:2.0:1788843098.438981:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843098.439032:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795660928:0@lo:400:kworker.0 00000100:00100000:2.0:1788843098.439053:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843098.439076:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843098.439081:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795660800:0@lo:400:kworker.0 00000100:00100000:2.0:1788843098.439101:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843098.439126:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795660544:0@lo:400:kworker.0 00000100:00100000:2.0:1788843098.439145:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843098.439160:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795661056:0@lo:400:kworker.0 00000100:00100000:2.0:1788843098.439176:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843098.439192:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843098.439196:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795660672:0@lo:400:kworker.0 00000100:00100000:2.0:1788843098.439212:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843098.439304:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795660416 00000100:00100000:2.0:1788843098.439313:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795660416 00000100:00100000:2.0:1788843098.439372:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788843098.439389:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795660416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843098.439436:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795660416:12345-0@lo:400:kworker.0 Request processed in 49us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843098.439443:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:2.0:1788843098.439473:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795660928 00000100:00100000:2.0:1788843098.439476:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795660928 00000100:00100000:2.0:1788843098.439507:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795660544 00000100:00100000:2.0:1788843098.439509:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795660544 00000100:00100000:2.0:1788843098.439518:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795660672 00000100:00100000:2.0:1788843098.439519:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795660672 00000100:00100000:2.0:1788843098.439530:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788843098.439535:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795660928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843098.439564:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795660928:12345-0@lo:400:kworker.0 Request processed in 28us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843098.439570:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788843098.439580:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788843098.439585:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795660544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843098.439607:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795660544:12345-0@lo:400:kworker.0 Request processed in 23us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843098.439613:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788843098.439622:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788843098.439627:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795660672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843098.439647:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e848e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795660672:12345-0@lo:400:kworker.0 Request processed in 20us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843098.439652:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788843098.439666:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795660800 00000100:00100000:2.0:1788843098.439668:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795660800 00000100:00100000:2.0:1788843098.439694:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795661056 00000100:00100000:2.0:1788843098.439696:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795661056 00000100:00100000:2.0:1788843098.439711:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843098.439716:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795660800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843098.439743:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795660800:12345-0@lo:400:kworker.0 Request processed in 27us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843098.439748:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843098.439758:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788843098.439762:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795661056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843098.439782:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795661056:12345-0@lo:400:kworker.0 Request processed in 20us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843098.439798:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788843098.439816:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788843098.439819:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843098.439846:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795660672:0@lo:400:kworker.0 00000100:00100000:2.0:1788843098.439856:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795660544:0@lo:400:kworker.0 00010000:00080000:2.0:1788843098.439868:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e849c00 x1875737795661056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843098.439879:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795661056:0@lo:400:kworker.0 00010000:00080000:2.0:1788843098.439909:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e848380 x1875737795660800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843114 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843098.439917:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e848380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795660800:0@lo:400:kworker.0 00000100:00100000:2.0:1788843098.439924:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795660416:0@lo:400:kworker.0 00000100:00100000:2.0:1788843098.439933:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795660928:0@lo:400:kworker.0 00010000:00010000:3.0:1788843098.887733:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843098.948906:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843098.948934:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795661184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843098.949019:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843098.949095:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795661184 00000100:00100000:1.0:1788843098.949104:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795661184 00000100:00100000:1.0:1788843098.949159:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788843098.949168:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795661184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843098.949211:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843098.949265:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51456d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795661184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843098.949272:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788843098.949318:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab51457b80 x1875737795661184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843114 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843098.949336:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795661184:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788843099.342202:0:8810:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788843099.909371:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843100.932639:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843101.956788:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843102.355465:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843102.355552:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775709056 00000100:00100000:2.0:1788843102.355561:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775709056 00000100:00100000:2.0:1788843102.355612:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 192 00000100:00100000:2.0:1788843102.355621:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2359:x1875737775709056:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843102.355690:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2359:x1875737775709056:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 70us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843102.355697:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 192 00000100:00100000:3.0:1788843102.367795:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843102.367851:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843102.367892:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843102.367927:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775709312 00000100:00100000:3.0:1788843102.367940:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775709312 00000100:00100000:3.0:1788843102.368008:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775709440 00000100:00100000:3.0:1788843102.368011:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775709440 00000100:00100000:3.0:1788843102.368042:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:3.0:1788843102.368053:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775709312:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843102.368148:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c183480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775709312:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 97us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843102.368156:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:3.0:1788843102.368176:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1788843102.368182:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775709440:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843102.368463:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775709440:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 24us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843102.368471:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00080000:3.0:1788843102.368490:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843102.368494:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843102.369247:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775709184 00000100:00100000:1.0:1788843102.369256:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775709184 00000100:00100000:1.0:1788843102.369337:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:1.0:1788843102.369369:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2359:x1875737775709184:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843102.369432:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2359:x1875737775709184:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 66us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843102.369440:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00080000:3.0:1788843102.369922:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843102.536109:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795661312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843102.536176:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843102.536426:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795661312 00000100:00100000:3.0:1788843102.536433:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795661312 00000100:00100000:3.0:1788843102.536497:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788843102.536506:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795661312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843102.536543:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788843102.536547:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843102.537064:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795661312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 558us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843102.537072:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:0.0:1788843102.537153:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e848700 x1875737795661312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843102.537172:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795661312:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788843102.981244:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843103.559685:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795661824:0@lo:400:kworker.0 00000100:00100000:1.0:1788843103.559778:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843103.559841:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788843103.559848:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795661440:0@lo:400:kworker.0 00000100:00100000:1.0:1788843103.559878:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843103.559902:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795661952:0@lo:400:kworker.0 00000100:00100000:1.0:1788843103.559955:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843103.559985:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795661568:0@lo:400:kworker.0 00000100:00100000:1.0:1788843103.560010:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843103.560028:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795662080:0@lo:400:kworker.0 00000100:00100000:1.0:1788843103.560049:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843103.560064:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843103.560069:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795661696:0@lo:400:kworker.0 00000100:00100000:1.0:1788843103.560091:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843103.560121:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795661440 00000100:00100000:1.0:1788843103.560129:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795661440 00000100:00100000:1.0:1788843103.560171:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788843103.560180:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795661440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843103.560245:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795661440:12345-0@lo:400:kworker.0 Request processed in 65us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843103.560253:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1788843103.560282:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795661952 00000100:00100000:1.0:1788843103.560286:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795661952 00000100:00100000:1.0:1788843103.560323:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795661568 00000100:00100000:1.0:1788843103.560326:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795661568 00000100:00100000:1.0:1788843103.560335:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795661696 00000100:00100000:1.0:1788843103.560337:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795661696 00000100:00100000:1.0:1788843103.560372:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788843103.560379:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795661952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843103.560409:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795661952:12345-0@lo:400:kworker.0 Request processed in 30us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843103.560415:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788843103.560425:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788843103.560430:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795661568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843103.560458:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795661568:12345-0@lo:400:kworker.0 Request processed in 28us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843103.560464:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788843103.560473:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788843103.560479:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795661696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843103.560501:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795661696:12345-0@lo:400:kworker.0 Request processed in 23us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843103.560506:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788843103.560530:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843103.560560:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795661696:0@lo:400:kworker.0 00000100:00100000:1.0:1788843103.560581:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795661568:0@lo:400:kworker.0 00000100:00100000:1.0:1788843103.560607:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795661440:0@lo:400:kworker.0 00000100:00100000:1.0:1788843103.560616:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795661952:0@lo:400:kworker.0 00000100:00100000:3.0:1788843103.560903:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795661824 00000100:00100000:3.0:1788843103.560908:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795661824 00000100:00100000:3.0:1788843103.560949:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795662080 00000100:00100000:3.0:1788843103.560952:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795662080 00000100:00100000:3.0:1788843103.560980:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788843103.560987:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795661824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843103.561035:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795661824:12345-0@lo:400:kworker.0 Request processed in 49us (1257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843103.561041:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788843103.561054:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788843103.561060:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795662080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843103.561092:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795662080:12345-0@lo:400:kworker.0 Request processed in 33us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843103.561097:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1788843103.561117:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788843103.561138:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab51456300 x1875737795662080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843103.561150:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795662080:0@lo:400:kworker.0 00010000:00080000:3.0:1788843103.561174:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab51456680 x1875737795661824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843119 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843103.561195:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51456680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795661824:0@lo:400:kworker.0 00010000:00010000:1.0:1788843104.008458:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843104.070414:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7778fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795662208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843104.070481:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843104.070657:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795662208 00000100:00100000:2.0:1788843104.070664:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795662208 00000100:00100000:2.0:1788843104.070713:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843104.070721:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795662208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788843104.070761:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788843104.070814:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795662208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843104.070822:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1788843104.071004:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7778fb80 x1875737795662208/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843120 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843104.071024:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7778fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795662208:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788843104.863065:0:9055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing yml_node 00010000:00010000:2.0:1788843105.029530:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843106.056845:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843107.077919:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843107.480538:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843107.480583:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843107.480671:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775709568 00000100:00100000:3.0:1788843107.480676:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843107.480682:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775709568 00000100:00100000:2.0:1788843107.480750:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 194 00000100:00100000:2.0:1788843107.480764:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2359:x1875737775709568:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843107.480787:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843107.480828:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775709696 00000100:00100000:1.0:1788843107.480834:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775709696 00000100:00100000:2.0:1788843107.480838:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2359:x1875737775709568:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 76us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843107.480847:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 194 00000100:00100000:0.0:1788843107.480885:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775709824 00000100:00100000:0.0:1788843107.480891:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775709824 00000100:00100000:1.0:1788843107.480894:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:1.0:1788843107.480906:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775709696:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843107.480944:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775709696:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 40us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843107.480950:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00080000:1.0:1788843107.480983:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788843107.480988:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843107.481011:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775709952 00000100:00100000:3.0:1788843107.481016:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775709952 00000100:00100000:3.0:1788843107.481082:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:3.0:1788843107.481090:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2355:x1875737775709952:12345-192.168.203.29@tcp:9:kworker.0 00000100:00080000:1.0:1788843107.481100:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1788843107.481283:0:8216:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914c91 00000100:00080000:3.0:1788843107.481295:0:8216:0:(import.c:65:import_set_state_nolock()) ffff8dab6e6e1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788843107.481373:0:8216:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:1.0:1788843107.481506:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843107.482236:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+2:2355:x1875737775709952:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 1142us (1557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843107.482246:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:0.0:1788843107.484512:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:0.0:1788843107.484532:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2355:x1875737775709824:12345-192.168.203.29@tcp:9:kworker.0 00000020:00000080:0.0:1788843107.484574:0:6694:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914c8a 00000100:00080000:0.0:1788843107.484585:0:6694:0:(import.c:65:import_set_state_nolock()) ffff8dab73d8b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788843107.485500:0:6694:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788843107.485995:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+2:2355:x1875737775709824:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 1466us (5405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843107.486007:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00010000:00010000:2.0:1788843107.488859:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843107.652873:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795662336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843107.652951:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843107.653295:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795662336 00000100:00100000:1.0:1788843107.653304:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795662336 00000100:00080000:0.0:1788843107.653378:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843107.653414:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788843107.653426:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795662336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843107.653468:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843107.655967:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795662336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2532us (3003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843107.655981:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788843107.657894:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e849f80 x1875737795662336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843123 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843107.657940:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795662336:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788843108.100598:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843108.676914:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843108.676946:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7778d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795662464:0@lo:400:kworker.0 00000100:00100000:1.0:1788843108.676977:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7778e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795662720:0@lo:400:kworker.0 00000100:00100000:2.0:1788843108.677086:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7778df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795662592:0@lo:400:kworker.0 00000100:00100000:3.0:1788843108.677116:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843108.677225:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843108.677301:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795662464 00000100:00100000:1.0:1788843108.677310:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795662464 00000100:00100000:1.0:1788843108.677377:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788843108.677387:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795662464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843108.677453:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795662464:12345-0@lo:400:kworker.0 Request processed in 68us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843108.677461:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788843108.677497:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795662720 00000100:00100000:1.0:1788843108.677501:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795662720 00000100:00100000:1.0:1788843108.677548:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788843108.677555:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795662720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843108.677590:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795662720:12345-0@lo:400:kworker.0 Request processed in 36us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843108.677597:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:1.0:1788843108.677615:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843108.677654:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7778e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795662720:0@lo:400:kworker.0 00000100:00100000:0.0:1788843108.679560:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7778c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795662976:0@lo:400:kworker.0 00000100:00100000:0.0:1788843108.679638:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843108.679695:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843108.679703:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7778f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795662848:0@lo:400:kworker.0 00000100:00100000:0.0:1788843108.679757:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843108.679799:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795662848 00000100:00100000:0.0:1788843108.679808:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795662848 00000100:00100000:0.0:1788843108.679863:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788843108.679874:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795662848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843108.679890:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795662976 00000100:00100000:1.0:1788843108.679898:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795662976 00000100:00100000:0.0:1788843108.679947:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795662848:12345-0@lo:400:kworker.0 Request processed in 73us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843108.679956:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788843108.679962:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788843108.679972:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795662976:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1788843108.680005:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7778f480 x1875737795662848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843108.680021:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7778f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795662848:0@lo:400:kworker.0 00000100:00100000:0.0:1788843108.680041:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7778c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795662976:0@lo:400:kworker.0 00000100:00100000:1.0:1788843108.680043:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795662976:12345-0@lo:400:kworker.0 Request processed in 72us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843108.680054:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1788843108.680079:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843108.684783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843108.684850:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795663104:0@lo:400:kworker.0 00000100:00100000:2.0:1788843108.684884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843108.686273:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795662592 00000100:00100000:1.0:1788843108.686286:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795662592 00000100:00100000:1.0:1788843108.686402:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788843108.686412:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795662592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843108.686757:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795662592:12345-0@lo:400:kworker.0 Request processed in 345us (1979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843108.686765:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788843108.686859:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7778df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795662592:0@lo:400:kworker.0 00000100:00100000:0.0:1788843108.686930:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795663104 00000100:00100000:0.0:1788843108.686936:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795663104 00000100:00100000:0.0:1788843108.686985:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788843108.686992:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795663104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843108.687035:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795663104:12345-0@lo:400:kworker.0 Request processed in 44us (2150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843108.687042:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788843108.687071:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7778c700 x1875737795663104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843124 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843108.687082:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7778c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795663104:0@lo:400:kworker.0 00000100:00080000:1.0:1788843108.690519:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843108.698327:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7778d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795662464:0@lo:400:kworker.0 00010000:00010000:0.0:1788843109.125443:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843109.189552:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843109.189577:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795663232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843109.189665:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843109.192575:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795663232 00000100:00100000:3.0:1788843109.192588:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795663232 00000100:00100000:3.0:1788843109.192655:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788843109.192666:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795663232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843109.192712:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788843109.192816:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795663232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (3151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843109.192824:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788843109.192854:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e84a300 x1875737795663232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843125 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843109.192879:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795663232:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788843109.648626:0:9247:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.112 00000001:00100000:2.0:1788843109.769205:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fb38c5ab-0241-4970-81c2-7e93fb808128 00000020:00000080:2.0:1788843109.769216:0:6719:0:(genops.c:885:class_export_put()) final put ffff8dab73d8b000/fb38c5ab-0241-4970-81c2-7e93fb808128 00000020:00000080:1.0:1788843109.769761:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab73d8b000/fb38c5ab-0241-4970-81c2-7e93fb808128 for lustre-OST0000 00000020:00000080:1.0:1788843109.769813:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab73d8b800 for lustre-OST0000 00010000:00010000:1.0:1788843110.148626:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843111.172698:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788843111.775048:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fb38c5ab-0241-4970-81c2-7e93fb808128 00000020:00000080:2.0:1788843111.775057:0:7650:0:(genops.c:885:class_export_put()) final put ffff8dab6e6e2800/fb38c5ab-0241-4970-81c2-7e93fb808128 00000020:00000080:3.0:1788843111.775127:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab6e6e2800/fb38c5ab-0241-4970-81c2-7e93fb808128 for lustre-OST0001 00000020:00000080:3.0:1788843111.775182:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab6e6e1000 for lustre-OST0001 00000001:02000400:2.0:1788843112.081436:0:9347:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.112 00010000:00010000:2.0:1788843112.196646:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843112.593176:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843112.593251:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843112.593333:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775710208 00000100:00100000:3.0:1788843112.593378:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775710080 00000100:00100000:3.0:1788843112.593387:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775710080 00000100:00100000:2.0:1788843112.593390:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775710208 00000100:00100000:3.0:1788843112.593445:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 196 00000100:00100000:3.0:1788843112.593457:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2356:x1875737775710080:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843112.593460:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:2.0:1788843112.593475:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2357:x1875737775710208:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843112.593639:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2357:x1875737775710208:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 168us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843112.593647:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00080000:1.0:1788843112.593846:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843112.598081:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2356:x1875737775710080:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 4613us (4815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843112.598097:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 196 00000100:00100000:1.0:1788843112.780576:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843112.786011:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795663360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843112.786096:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843112.786188:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795663360 00000100:00100000:0.0:1788843112.786198:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795663360 00000100:00100000:0.0:1788843112.786293:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788843112.786304:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795663360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843112.787519:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843112.787620:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795663360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1314us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843112.787629:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788843112.787727:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788843112.787792:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7cd43100 x1875737795663360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843128 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843112.787831:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795663360:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788843113.220685:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843113.796848:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795663616:0@lo:400:kworker.0 00000100:00100000:0.0:1788843113.796938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843113.797034:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843113.797048:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795663488:0@lo:400:kworker.0 00000100:00100000:1.0:1788843113.797089:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843113.797127:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795663488 00000100:00100000:1.0:1788843113.797135:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795663488 00000100:00100000:1.0:1788843113.797178:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788843113.797189:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795663488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843113.797239:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795663488:12345-0@lo:400:kworker.0 Request processed in 52us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843113.797259:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:1.0:1788843113.797311:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795663488:0@lo:400:kworker.0 00000100:00100000:1.0:1788843113.797367:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795663616 00000100:00100000:1.0:1788843113.797372:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795663616 00000100:00100000:1.0:1788843113.797412:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788843113.797419:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795663616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843113.797576:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795663744:0@lo:400:kworker.0 00000100:00100000:3.0:1788843113.797607:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843113.797644:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795663744 00000100:00100000:3.0:1788843113.797649:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795663744 00000100:00100000:3.0:1788843113.797701:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788843113.797709:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795663744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843113.797746:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795663744:12345-0@lo:400:kworker.0 Request processed in 38us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843113.797752:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1788843113.797773:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843113.797801:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795663744:0@lo:400:kworker.0 00000100:00100000:1.0:1788843113.798314:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795663616:12345-0@lo:400:kworker.0 Request processed in 894us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843113.798321:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788843113.798498:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795663616:0@lo:400:kworker.0 00000100:00100000:1.0:1788843113.798825:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795663872:0@lo:400:kworker.0 00000100:00100000:1.0:1788843113.798878:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843113.798987:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795663872 00000100:00100000:0.0:1788843113.798992:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795663872 00000100:00100000:0.0:1788843113.799037:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843113.799046:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795663872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843113.799207:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795664000:0@lo:400:kworker.0 00000100:00100000:3.0:1788843113.799236:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843113.799271:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795664000 00000100:00100000:3.0:1788843113.799275:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795664000 00000100:00100000:3.0:1788843113.799312:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788843113.799318:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795664000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843113.799374:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795664000:12345-0@lo:400:kworker.0 Request processed in 56us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843113.799394:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788843113.799416:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843113.799448:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e848a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795664000:0@lo:400:kworker.0 00000100:00100000:0.0:1788843113.799814:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795663872:12345-0@lo:400:kworker.0 Request processed in 768us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843113.799822:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788843113.799969:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e849880 x1875737795663872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843113.799981:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e849880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795663872:0@lo:400:kworker.0 00000100:00100000:0.0:1788843113.800146:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795664128:0@lo:400:kworker.0 00000100:00100000:0.0:1788843113.800185:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843113.800249:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795664128 00000100:00100000:3.0:1788843113.800269:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795664128 00000100:00100000:3.0:1788843113.800317:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788843113.800325:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795664128:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788843113.800413:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843113.800827:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec49500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795664128:12345-0@lo:400:kworker.0 Request processed in 501us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843113.800833:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788843113.800937:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e84b800 x1875737795664128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843129 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843113.800948:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795664128:0@lo:400:kworker.0 00010000:00010000:1.0:1788843114.245608:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843114.310825:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843114.310853:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795664256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843114.310925:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843114.310954:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795664256 00000100:00100000:3.0:1788843114.310964:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795664256 00000100:00100000:3.0:1788843114.311017:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788843114.311028:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795664256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843114.311063:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788843114.311121:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795664256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843114.311127:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788843114.311185:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffc1c00 x1875737795664256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843130 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843114.311215:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795664256:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788843114.626260:0:9444:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.112 00010000:00010000:2.0:1788843115.268944:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788843116.129723:0:9492:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Tue Sep 8 00:51:54 EDT 2026 00010000:00010000:3.0:1788843116.299188:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843117.318191:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843117.716904:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843117.717002:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843117.717046:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775710336 00000100:00100000:1.0:1788843117.717058:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775710336 00000100:00100000:1.0:1788843117.717248:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 198 00000100:00100000:1.0:1788843117.717263:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2358:x1875737775710336:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843117.717402:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2358:x1875737775710336:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 141us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843117.717411:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 198 00000100:00100000:2.0:1788843117.718371:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775710464 00000100:00100000:2.0:1788843117.718382:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775710464 00000100:00100000:2.0:1788843117.718467:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:2.0:1788843117.718479:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775710464:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843117.718562:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775710464:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 86us (1676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843117.718570:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00080000:1.0:1788843117.723119:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843117.894647:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843117.894686:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7778d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795664384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843117.894782:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843117.894869:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795664384 00000100:00100000:1.0:1788843117.894878:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795664384 00000100:00100000:1.0:1788843117.894945:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788843117.894955:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795664384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843117.895003:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843117.895056:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795664384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843117.895064:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1788843117.895091:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788843117.895128:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7778d500 x1875737795664384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843133 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843117.895150:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7778d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795664384:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788843118.340621:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843118.919213:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795664512:0@lo:400:kworker.0 00000100:00100000:2.0:1788843118.919319:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843118.919423:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795665024:0@lo:400:kworker.0 00000100:00100000:2.0:1788843118.919453:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843118.919493:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843118.919499:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795664896:0@lo:400:kworker.0 00000100:00100000:2.0:1788843118.919526:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843118.919630:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795664640:0@lo:400:kworker.0 00000100:00100000:2.0:1788843118.919738:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843118.919758:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795665152:0@lo:400:kworker.0 00000100:00100000:2.0:1788843118.919801:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843118.919825:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843118.919837:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795664768:0@lo:400:kworker.0 00000100:00100000:2.0:1788843118.919860:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843118.919899:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795664512 00000100:00100000:2.0:1788843118.919908:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795664512 00000100:00100000:2.0:1788843118.919962:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788843118.919972:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795664512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843118.920169:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795664512:12345-0@lo:400:kworker.0 Request processed in 196us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843118.920178:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788843118.920219:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795664896 00000100:00100000:2.0:1788843118.920223:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795664896 00000100:00100000:2.0:1788843118.920246:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795665152 00000100:00100000:2.0:1788843118.920249:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795665152 00000100:00100000:2.0:1788843118.920275:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788843118.920281:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795664896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843118.920314:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795664896:12345-0@lo:400:kworker.0 Request processed in 33us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843118.920320:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788843118.920331:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788843118.920337:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795665152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843118.920399:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795665152:12345-0@lo:400:kworker.0 Request processed in 62us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843118.920405:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788843118.920423:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795665024 00000100:00100000:2.0:1788843118.920427:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795665024 00000100:00100000:2.0:1788843118.920461:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795664640 00000100:00100000:2.0:1788843118.920464:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795664640 00000100:00100000:2.0:1788843118.920473:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795664768 00000100:00100000:2.0:1788843118.920482:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795664768 00000100:00100000:2.0:1788843118.920497:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788843118.920503:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795665024:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788843118.925599:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843118.925617:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843118.926188:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795665024:12345-0@lo:400:kworker.0 Request processed in 5673us (6721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843118.926204:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788843118.926262:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788843118.926282:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795664640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843118.926402:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795664640:12345-0@lo:400:kworker.0 Request processed in 131us (6663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843118.926408:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788843118.926421:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788843118.926430:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795664768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843118.926465:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795664768:12345-0@lo:400:kworker.0 Request processed in 38us (6604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843118.926471:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788843118.926768:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e848700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795664768:0@lo:400:kworker.0 00000100:00100000:2.0:1788843118.926785:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e849f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795664640:0@lo:400:kworker.0 00010000:00080000:2.0:1788843118.926803:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e84ad80 x1875737795665152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843118.926814:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795665152:0@lo:400:kworker.0 00010000:00080000:2.0:1788843118.926870:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e84bb80 x1875737795664896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843134 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843118.926881:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795664896:0@lo:400:kworker.0 00000100:00100000:2.0:1788843118.926920:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795664512:0@lo:400:kworker.0 00000100:00100000:2.0:1788843118.926935:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795665024:0@lo:400:kworker.0 00010000:00010000:2.0:1788843119.366480:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843119.431101:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843119.431148:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795665280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843119.431270:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843119.431395:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795665280 00000100:00100000:1.0:1788843119.431408:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795665280 00000100:00100000:1.0:1788843119.431475:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788843119.431486:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795665280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843119.431543:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843119.431637:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795665280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843119.431664:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:1.0:1788843119.431756:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7bc45f80 x1875737795665280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843135 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843119.431788:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795665280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788843120.389717:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843121.416419:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843122.437655:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843122.835144:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843122.835200:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843122.835269:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775710720 00000100:00100000:2.0:1788843122.835281:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775710720 00000100:00100000:3.0:1788843122.835333:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775710592 00000100:00100000:3.0:1788843122.835368:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775710592 00000100:00100000:3.0:1788843122.835417:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 200 00000100:00100000:2.0:1788843122.835419:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:3.0:1788843122.835430:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2357:x1875737775710592:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843122.835433:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2357:x1875737775710720:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843122.835526:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2357:x1875737775710592:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 98us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843122.835536:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 200 00000100:00080000:1.0:1788843122.835675:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843122.838047:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2357:x1875737775710720:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 2595us (2892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843122.838064:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:1.0:1788843123.012482:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843123.012504:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7778d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795665408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843123.012564:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843123.012618:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795665408 00000100:00100000:1.0:1788843123.012639:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795665408 00000100:00100000:1.0:1788843123.012699:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788843123.012710:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795665408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843123.012755:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843123.012802:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795665408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843123.012810:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788843123.012834:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788843123.012870:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7778d180 x1875737795665408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843123.012891:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7778d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795665408:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788843123.460714:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843124.039468:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795665792:0@lo:400:kworker.0 00000100:00100000:3.0:1788843124.039560:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843124.039636:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788843124.039643:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795665664:0@lo:400:kworker.0 00000100:00100000:3.0:1788843124.039671:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843124.039691:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795666176:0@lo:400:kworker.0 00000100:00100000:3.0:1788843124.039716:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843124.039766:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795665792 00000100:00100000:3.0:1788843124.039774:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795665792 00000100:00100000:3.0:1788843124.039848:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795665664 00000100:00100000:3.0:1788843124.039851:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795665664 00000100:00100000:3.0:1788843124.039874:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788843124.039884:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795665792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843124.039939:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795665792:12345-0@lo:400:kworker.0 Request processed in 56us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843124.039947:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788843124.039964:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788843124.039970:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795665664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843124.039997:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795665664:12345-0@lo:400:kworker.0 Request processed in 28us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843124.040004:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788843124.040019:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843124.040066:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795665664:0@lo:400:kworker.0 00000100:00100000:3.0:1788843124.040076:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795665792:0@lo:400:kworker.0 00000100:00100000:1.0:1788843124.040752:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795665536:0@lo:400:kworker.0 00000100:00100000:1.0:1788843124.040829:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843124.040869:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795666048:0@lo:400:kworker.0 00000100:00100000:1.0:1788843124.040891:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843124.040912:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843124.040918:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795665920:0@lo:400:kworker.0 00000100:00100000:1.0:1788843124.040936:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843124.040963:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795666176 00000100:00100000:1.0:1788843124.040968:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795666176 00000100:00100000:1.0:1788843124.041002:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795665920 00000100:00100000:1.0:1788843124.041005:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795665920 00000100:00100000:1.0:1788843124.041020:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843124.041038:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795666176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843124.041077:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795666176:12345-0@lo:400:kworker.0 Request processed in 40us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843124.041084:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843124.041101:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788843124.041107:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795665920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843124.041139:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795665920:12345-0@lo:400:kworker.0 Request processed in 33us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843124.041145:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788843124.041160:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788843124.041181:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffc1500 x1875737795665920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843124.041193:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795665920:0@lo:400:kworker.0 00000100:00100000:1.0:1788843124.041211:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795666048 00000100:00100000:1.0:1788843124.041214:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795666048 00000100:00100000:1.0:1788843124.041252:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788843124.041721:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795666048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843124.042227:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795666048:12345-0@lo:400:kworker.0 Request processed in 268us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843124.042235:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788843124.042265:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843124.043446:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795665536 00000100:00100000:3.0:1788843124.043457:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795665536 00000100:00100000:3.0:1788843124.043530:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1788843124.043552:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795665536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843124.043662:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795665536:12345-0@lo:400:kworker.0 Request processed in 110us (2832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843124.043669:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00010000:00080000:3.0:1788843124.044148:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffc0a80 x1875737795666176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843140 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843124.044165:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795666176:0@lo:400:kworker.0 00000100:00100000:2.0:1788843124.044331:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795665536:0@lo:400:kworker.0 00000100:00100000:2.0:1788843124.044376:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795666048:0@lo:400:kworker.0 00010000:00010000:3.0:1788843124.488079:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843124.554845:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843124.554868:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795666304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843124.554941:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843124.554971:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795666304 00000100:00100000:1.0:1788843124.554979:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795666304 00000100:00100000:1.0:1788843124.555028:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788843124.555038:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795666304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843124.555131:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843124.555183:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795666304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843124.555190:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788843124.555693:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7bc46300 x1875737795666304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843140 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843124.555712:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795666304:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788843125.516558:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843126.532522:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843127.556954:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843127.960041:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843127.960098:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843127.960137:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775710976 00000100:00100000:2.0:1788843127.960147:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775710976 00000100:00100000:2.0:1788843127.960534:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:2.0:1788843127.960546:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2356:x1875737775710976:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843127.960790:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2356:x1875737775710976:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 245us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843127.960800:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00080000:2.0:1788843127.960828:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843127.960998:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775710848 00000100:00100000:0.0:1788843127.961005:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775710848 00000100:00100000:0.0:1788843127.961036:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 202 00000100:00100000:0.0:1788843127.961044:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2356:x1875737775710848:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843127.961078:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2356:x1875737775710848:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 35us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843127.961085:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 202 00000100:00100000:3.0:1788843128.135935:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795666432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843128.136032:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843128.140546:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795666432 00000100:00100000:1.0:1788843128.140568:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795666432 00000100:00100000:1.0:1788843128.140873:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788843128.140885:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795666432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843128.140935:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843128.141063:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795666432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (5031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843128.141071:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788843128.141301:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffc0a80 x1875737795666432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843128.141328:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795666432:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788843128.141605:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788843128.581556:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843129.162160:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795666944:0@lo:400:kworker.0 00000100:00100000:2.0:1788843129.162253:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843129.162358:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788843129.162376:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795666560:0@lo:400:kworker.0 00000100:00100000:2.0:1788843129.162413:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843129.162440:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795667072:0@lo:400:kworker.0 00000100:00100000:2.0:1788843129.162467:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843129.162497:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795666688:0@lo:400:kworker.0 00000100:00100000:2.0:1788843129.162521:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843129.162541:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795667200:0@lo:400:kworker.0 00000100:00100000:2.0:1788843129.162562:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843129.162594:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843129.162600:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795666816:0@lo:400:kworker.0 00000100:00100000:2.0:1788843129.162622:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843129.162654:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795666944 00000100:00100000:2.0:1788843129.162665:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795666944 00000100:00100000:2.0:1788843129.162715:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795667200 00000100:00100000:2.0:1788843129.162718:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795667200 00000100:00100000:2.0:1788843129.162753:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788843129.162762:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795666944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843129.162825:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795666944:12345-0@lo:400:kworker.0 Request processed in 64us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843129.162834:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788843129.162855:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788843129.162875:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795667200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843129.162910:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795667200:12345-0@lo:400:kworker.0 Request processed in 48us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843129.162917:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788843129.162935:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795666560 00000100:00100000:2.0:1788843129.162946:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795666560 00000100:00100000:2.0:1788843129.162973:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:2.0:1788843129.162978:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795666560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843129.163011:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795666560:12345-0@lo:400:kworker.0 Request processed in 33us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843129.163017:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00080000:1.0:1788843129.163815:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843129.163844:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795667072 00000100:00100000:1.0:1788843129.163850:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795667072 00000100:00100000:1.0:1788843129.163915:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795666688 00000100:00100000:1.0:1788843129.163919:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795666688 00000100:00100000:1.0:1788843129.163932:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795666816 00000100:00100000:1.0:1788843129.163935:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795666816 00000100:00100000:1.0:1788843129.163952:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788843129.163959:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795667072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843129.164027:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795667072:12345-0@lo:400:kworker.0 Request processed in 68us (1558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843129.164192:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788843129.164213:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788843129.164218:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795666688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843129.164251:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795666688:12345-0@lo:400:kworker.0 Request processed in 33us (1729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843129.164257:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788843129.164269:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788843129.164275:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795666816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843129.164301:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795666816:12345-0@lo:400:kworker.0 Request processed in 27us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843129.164307:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788843129.164332:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843129.165214:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795666560:0@lo:400:kworker.0 00000100:00100000:2.0:1788843129.165236:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795667072:0@lo:400:kworker.0 00010000:00080000:2.0:1788843129.165254:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7bc47100 x1875737795666944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843129.165265:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795666944:0@lo:400:kworker.0 00000100:00100000:2.0:1788843129.165321:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795666816:0@lo:400:kworker.0 00000100:00100000:2.0:1788843129.165336:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795666688:0@lo:400:kworker.0 00010000:00080000:2.0:1788843129.165382:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7bc46a00 x1875737795667200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843145 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843129.165390:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795667200:0@lo:400:kworker.0 00010000:00010000:0.0:1788843129.606630:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843129.669913:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843129.669942:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795667328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843129.670039:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843129.670079:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795667328 00000100:00100000:1.0:1788843129.670088:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795667328 00000100:00100000:1.0:1788843129.670148:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788843129.670160:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795667328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843129.670207:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843129.670269:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795667328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843129.670294:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788843129.670689:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7bc46a00 x1875737795667328/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843145 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843129.670712:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795667328:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788843130.628565:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843131.658152:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788843132.104754:0:10124:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 00:52:10 (1788843130) === 00000100:00100000:1.0:1788843132.601591:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843132.601728:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775711104 00000100:00100000:2.0:1788843132.601750:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775711104 00000100:00100000:2.0:1788843132.601808:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 204 00000100:00100000:2.0:1788843132.601818:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:8129:x1875737775711104:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788843132.601834:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843132.601851:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0914d55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084792 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843132.601878:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0914d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084792 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843132.601890:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0914d55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084792 expref: 11 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843132.601898:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88c00, rc 0) 00000100:00100000:2.0:1788843132.601956:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+11:8129:x1875737775711104:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 139us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843132.601973:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 204 00000100:00100000:3.0:1788843132.617086:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843132.619985:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775711232 00000100:00100000:2.0:1788843132.620001:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775711232 00000100:00100000:2.0:1788843132.620085:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 205 00000100:00100000:2.0:1788843132.620098:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+11:8129:x1875737775711232:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788843132.621446:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+11:8129:x1875737775711232:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 1341us (4368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843132.621457:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 205 00000100:00100000:3.0:1788843132.635467:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843132.638408:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775711360 00000100:00100000:1.0:1788843132.638424:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775711360 00000100:00100000:2.0:1788843132.640294:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 206 00000100:00100000:2.0:1788843132.640316:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+11:8129:x1875737775711360:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788843132.641078:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+11:8129:x1875737775711360:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 768us (5623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843132.641094:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 206 00000100:00100000:1.0:1788843132.647416:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843132.649594:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775711488 00000100:00100000:2.0:1788843132.649609:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775711488 00000100:00100000:2.0:1788843132.649682:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 207 00000100:00100000:2.0:1788843132.649695:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+11:8133:x1875737775711488:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843132.650019:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+11:8133:x1875737775711488:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 327us (2611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843132.650027:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 207 00010000:00010000:2.0:1788843132.678098:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843132.685199:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843132.685294:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775711616 00000100:00100000:3.0:1788843132.685319:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775711616 00000100:00100000:3.0:1788843132.685447:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 208 00000100:00100000:3.0:1788843132.685460:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+11:8133:x1875737775711616:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788843132.685865:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+11:8133:x1875737775711616:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 406us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843132.685875:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 208 00000100:00100000:0.0:1788843132.704443:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843132.704964:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775711744 00000100:00100000:2.0:1788843132.704978:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775711744 00000100:00100000:2.0:1788843132.705047:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 209 00000100:00100000:2.0:1788843132.705059:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+11:8129:x1875737775711744:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788843132.705081:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843132.705103:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff89200/0xc6b8ac1b0914d5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c6070847bc expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843132.705139:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff89200/0xc6b8ac1b0914d5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070847bc expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843132.705153:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff89200/0xc6b8ac1b0914d5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070847bc expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843132.705166:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89200, rc 0) 00000100:00100000:2.0:1788843132.705246:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:8129:x1875737775711744:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 189us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843132.705269:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 209 00000100:00100000:1.0:1788843132.712549:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843132.713658:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775711872 00000100:00100000:2.0:1788843132.713675:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775711872 00000100:00100000:2.0:1788843132.713757:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 210 00000100:00100000:2.0:1788843132.713770:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:8129:x1875737775711872:12345-192.168.203.29@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788843132.713804:0:5840:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788843132.713845:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788843132.713851:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788843132.713854:0:5840:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788843132.713857:0:5840:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788843132.716669:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:8129:x1875737775711872:12345-192.168.203.29@tcp:256:mount.lustre.0 Request processed in 2882us (4114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843132.716687:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 210 00000100:00100000:1.0:1788843132.728627:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843132.728791:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775712000 00000100:00100000:3.0:1788843132.728814:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775712000 00000100:00100000:3.0:1788843132.728904:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 211 00000100:00100000:3.0:1788843132.728917:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:8129:x1875737775712000:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788843132.728939:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843132.728987:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab41532400/0xc6b8ac1b0914d63 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c6070847c3 expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843132.729026:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41532400/0xc6b8ac1b0914d63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070847c3 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843132.729040:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab41532400/0xc6b8ac1b0914d63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070847c3 expref: 13 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843132.729050:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41532400, rc 0) 00000100:00100000:3.0:1788843132.729138:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:8129:x1875737775712000:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 223us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843132.729146:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 211 00000100:00100000:1.0:1788843132.731523:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843132.733269:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775712128 00000100:00100000:2.0:1788843132.733291:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775712128 00000100:00100000:2.0:1788843132.733453:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 212 00000100:00100000:2.0:1788843132.733467:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:8129:x1875737775712128:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788843132.735251:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:8129:x1875737775712128:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 1778us (3732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843132.735264:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 212 00000100:00100000:1.0:1788843132.738841:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843132.739000:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775712256 00000100:00100000:0.0:1788843132.739013:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775712256 00000100:00100000:0.0:1788843132.739081:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 213 00000100:00100000:0.0:1788843132.739094:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:8129:x1875737775712256:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788843132.739455:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:8129:x1875737775712256:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 361us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843132.739464:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 213 00000100:00100000:1.0:1788843132.758593:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843132.762938:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775712384 00000100:00100000:2.0:1788843132.762961:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775712384 00000100:00100000:2.0:1788843132.763235:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 214 00000100:00100000:2.0:1788843132.763250:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:8138:x1875737775712384:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843132.763665:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:8138:x1875737775712384:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 416us (5085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843132.763682:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 214 00000100:00100000:1.0:1788843132.773513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843132.781232:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775712512 00000100:00100000:0.0:1788843132.781772:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775712512 00000100:00100000:3.0:1788843132.781998:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 215 00000100:00100000:1.0:1788843132.788923:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:8138:x1875737775712512:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788843132.789327:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:8138:x1875737775712512:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 7314us (15827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843132.789338:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 215 00000100:00100000:1.0:1788843132.793421:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843132.793478:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843132.793590:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775712896 00000100:00100000:2.0:1788843132.793601:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775712640 00000100:00100000:3.0:1788843132.793609:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775712896 00000100:00100000:2.0:1788843132.793613:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775712640 00000100:00100000:2.0:1788843132.793680:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:2.0:1788843132.793692:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2355:x1875737775712640:12345-192.168.203.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788843132.793739:0:5847:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b6d1c4e8-7f8e-438b-8c74-80bf75c52b59@192.168.203.29@tcp t0 exp 0000000000000000 cur 257 last 0 00000100:00100000:3.0:1788843132.793740:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:3.0:1788843132.793765:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775712896:12345-192.168.203.29@tcp:400:kworker.0 00000020:00000080:2.0:1788843132.793798:0:5847:0:(genops.c:1385:class_connect()) connect: client b6d1c4e8-7f8e-438b-8c74-80bf75c52b59, cookie 0xc6b8ac1b0914d6a 00000004:00100000:2.0:1788843132.793860:0:5847:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788843132.793880:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775712896:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 121us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843132.793889:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00080000:2.0:1788843132.794207:0:5847:0:(import.c:65:import_set_state_nolock()) ffff8dab77a7b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843132.794274:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:2355:x1875737775712640:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 583us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843132.794282:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00080000:1.0:1788843132.794481:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843132.799024:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843132.799087:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775712768 00000100:00100000:2.0:1788843132.799109:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843132.799110:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775712768 00000100:00100000:3.0:1788843132.799203:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775713024 00000100:00100000:3.0:1788843132.799207:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775713024 00000100:00100000:3.0:1788843132.799231:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:3.0:1788843132.799243:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+7:0:x1875737775712768:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788843132.799302:0:5848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788843132.799435:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+7:0:x1875737775712768:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 195us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843132.799443:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:3.0:1788843132.799535:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:3.0:1788843132.799602:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:8129:x1875737775713024:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788843132.799615:0:5848:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788843132.799639:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:8129:x1875737775713024:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 38us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843132.799646:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00080000:1.0:1788843132.801200:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843132.817527:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843132.817638:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775713152 00000100:00100000:3.0:1788843132.817647:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775713152 00000100:00100000:3.0:1788843132.817823:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:3.0:1788843132.817836:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:8129:x1875737775713152:12345-192.168.203.29@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788843132.817926:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:8129:x1875737775713152:12345-192.168.203.29@tcp:40:mount.lustre.0 Request processed in 93us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843132.817934:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:1.0:1788843132.826707:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843132.826793:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775713536 00000100:00100000:0.0:1788843132.826803:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775713536 00000100:00100000:0.0:1788843132.826898:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:0.0:1788843132.826911:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:8129:x1875737775713536:12345-192.168.203.29@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788843132.827215:0:5849:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788843132.827305:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:8129:x1875737775713536:12345-192.168.203.29@tcp:33:mount.lustre.0 Request processed in 396us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843132.827314:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:2.0:1788843132.831471:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843132.831520:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843132.831764:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775713280 00000100:00100000:1.0:1788843132.831773:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775713280 00000100:00100000:1.0:1788843132.831807:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775713408 00000100:00100000:1.0:1788843132.831821:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775713408 00000100:00100000:1.0:1788843132.831845:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:1.0:1788843132.831854:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1875737775713280:12345-192.168.203.29@tcp:8:mount.lustre.0 00000100:00100000:0.0:1788843132.831877:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:0.0:1788843132.831883:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1875737775713408:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788843132.831914:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b6d1c4e8-7f8e-438b-8c74-80bf75c52b59@192.168.203.29@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:0.0:1788843132.831945:0:6694:0:(genops.c:1385:class_connect()) connect: client b6d1c4e8-7f8e-438b-8c74-80bf75c52b59, cookie 0xc6b8ac1b0914d71 00002000:00100000:0.0:1788843132.831956:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b6d1c4e8-7f8e-438b-8c74-80bf75c52b59/ffff8dab77ab7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788843132.831980:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00010000:00080000:1.0:1788843132.831995:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b6d1c4e8-7f8e-438b-8c74-80bf75c52b59@192.168.203.29@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:1.0:1788843132.832011:0:6692:0:(genops.c:1385:class_connect()) connect: client b6d1c4e8-7f8e-438b-8c74-80bf75c52b59, cookie 0xc6b8ac1b0914d78 00002000:00100000:1.0:1788843132.832016:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b6d1c4e8-7f8e-438b-8c74-80bf75c52b59/ffff8dab7fcb0800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788843132.832029:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788843132.832400:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788843132.832430:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8dab7fcb1000 : changing import state from RECOVER to FULL 00002000:00080000:0.0:1788843132.832677:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788843132.832693:0:6694:0:(import.c:65:import_set_state_nolock()) ffff8dab77ab3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843132.832795:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:2355:x1875737775713280:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 939us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843132.832803:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:0.0:1788843132.833372:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:2355:x1875737775713408:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 1486us (1850us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843132.833381:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:2.0:1788843133.252826:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795667456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843133.252923:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843133.253091:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795667456 00000100:00100000:1.0:1788843133.253101:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795667456 00000100:00080000:0.0:1788843133.253270:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843133.253426:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843133.253439:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795667456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843133.253465:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843133.257637:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795667456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4188us (4701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843133.257654:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788843133.262392:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffc2680 x1875737795667456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843133.263020:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795667456:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788843133.700728:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843134.276700:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795667840:0@lo:400:kworker.0 00000100:00100000:3.0:1788843134.276768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843134.276827:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788843134.276844:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795667712:0@lo:400:kworker.0 00000100:00100000:3.0:1788843134.276868:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843134.276884:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795668224:0@lo:400:kworker.0 00000100:00100000:3.0:1788843134.276905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843134.276943:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795667840 00000100:00100000:3.0:1788843134.277124:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795667840 00000100:00100000:3.0:1788843134.277185:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795667712 00000100:00100000:3.0:1788843134.277188:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795667712 00000100:00100000:3.0:1788843134.277205:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788843134.277212:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795667840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843134.277257:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795667840:12345-0@lo:400:kworker.0 Request processed in 46us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843134.277264:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788843134.277278:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788843134.277283:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795667712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843134.277303:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795667712:12345-0@lo:400:kworker.0 Request processed in 21us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843134.277309:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788843134.277324:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795668224 00000100:00100000:3.0:1788843134.277327:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795668224 00000100:00100000:3.0:1788843134.277371:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788843134.277377:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795668224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843134.277401:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795668224:12345-0@lo:400:kworker.0 Request processed in 25us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843134.277406:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1788843134.277420:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843134.277425:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843134.277460:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795667712:0@lo:400:kworker.0 00010000:00080000:3.0:1788843134.277474:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffc3480 x1875737795668224/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843134.277483:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795668224:0@lo:400:kworker.0 00000100:00100000:3.0:1788843134.277492:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795667840:0@lo:400:kworker.0 00000100:00100000:2.0:1788843134.277646:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795667584:0@lo:400:kworker.0 00000100:00100000:2.0:1788843134.277684:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843134.277721:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795668096:0@lo:400:kworker.0 00000100:00100000:2.0:1788843134.277746:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843134.277764:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843134.277769:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795667968:0@lo:400:kworker.0 00000100:00100000:2.0:1788843134.277786:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843134.277808:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795668096 00000100:00100000:2.0:1788843134.277811:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795668096 00000100:00100000:2.0:1788843134.277850:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788843134.277856:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795668096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843134.277886:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795668096:12345-0@lo:400:kworker.0 Request processed in 30us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843134.277891:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788843134.277907:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795667968 00000100:00100000:2.0:1788843134.277910:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795667968 00000100:00100000:2.0:1788843134.277927:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788843134.277933:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795667968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843134.277979:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795667968:12345-0@lo:400:kworker.0 Request processed in 47us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843134.277986:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788843134.278005:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788843134.278024:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffc1f80 x1875737795667968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843150 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843134.278033:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795667968:0@lo:400:kworker.0 00000100:00100000:2.0:1788843134.278044:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795668096:0@lo:400:kworker.0 00000100:00100000:3.0:1788843134.278412:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795667584 00000100:00100000:3.0:1788843134.278417:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795667584 00000100:00100000:3.0:1788843134.278446:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788843134.278452:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795667584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843134.278507:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795667584:12345-0@lo:400:kworker.0 Request processed in 55us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843134.278514:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788843134.278566:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795667584:0@lo:400:kworker.0 00010000:00010000:1.0:1788843134.727983:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843134.788490:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795668352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843134.788569:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843134.788669:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795668352 00000100:00100000:2.0:1788843134.788677:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795668352 00000100:00100000:2.0:1788843134.788724:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788843134.788734:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795668352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788843134.788766:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788843134.788813:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795668352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843134.788820:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788843134.788863:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7bc46300 x1875737795668352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843150 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843134.788879:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795668352:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788843135.350490:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b6d1c4e8-7f8e-438b-8c74-80bf75c52b59 00010000:00010000:2.0:1788843135.752904:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843136.775416:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788843136.941923:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b6d1c4e8-7f8e-438b-8c74-80bf75c52b59 00000001:00100000:0.0:1788843137.418750:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b6d1c4e8-7f8e-438b-8c74-80bf75c52b59 00010000:00010000:0.0:1788843137.797614:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843138.212216:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843138.212274:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843138.212306:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843138.212337:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843138.212401:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843138.212435:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775713920 00000100:00100000:3.0:1788843138.212698:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775713792 00000100:00100000:3.0:1788843138.212709:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775713792 00000100:00100000:3.0:1788843138.212782:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:3.0:1788843138.212793:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2359:x1875737775713792:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843138.212873:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2359:x1875737775713792:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 82us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843138.212881:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:3.0:1788843138.213039:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775714176 00000100:00100000:3.0:1788843138.213045:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775714176 00000100:00100000:3.0:1788843138.213071:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775714048 00000100:00100000:3.0:1788843138.213073:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775714048 00000100:00100000:3.0:1788843138.213093:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:3.0:1788843138.213100:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775714176:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843138.213129:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775714176:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 30us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843138.213135:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:3.0:1788843138.213145:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:3.0:1788843138.213165:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775714048:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843138.213191:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775714048:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 27us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843138.213196:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00080000:3.0:1788843138.213228:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788843138.213244:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843138.213246:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843138.214030:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775713664 00000100:00100000:1.0:1788843138.214040:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775713664 00000100:00100000:1.0:1788843138.214099:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 217 00000100:00100000:1.0:1788843138.214107:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2359:x1875737775713664:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843138.214173:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2359:x1875737775713664:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 66us (1967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843138.214192:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 217 00000100:00100000:2.0:1788843138.214838:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775713920 00000100:00100000:2.0:1788843138.214950:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:2.0:1788843138.214959:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775713920:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843138.215033:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775713920:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 75us (2757us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843138.215039:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00080000:0.0:1788843138.215739:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843138.372679:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843138.372703:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795668480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843138.372791:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843138.373095:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795668480 00000100:00100000:1.0:1788843138.373103:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795668480 00000100:00100000:1.0:1788843138.373171:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788843138.373181:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795668480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843138.373221:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843138.373297:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795668480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843138.373304:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1788843138.373405:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffc0000 x1875737795668480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843138.373424:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795668480:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788843138.373628:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788843138.820529:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843139.402506:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795668992:0@lo:400:kworker.0 00000100:00100000:1.0:1788843139.402589:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843139.402642:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788843139.402648:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795668608:0@lo:400:kworker.0 00000100:00100000:1.0:1788843139.402677:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843139.402698:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795669120:0@lo:400:kworker.0 00000100:00100000:1.0:1788843139.402723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843139.403148:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795668736:0@lo:400:kworker.0 00000100:00100000:2.0:1788843139.403184:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843139.403235:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795669248:0@lo:400:kworker.0 00000100:00100000:2.0:1788843139.403257:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843139.403280:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843139.403286:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795668864:0@lo:400:kworker.0 00000100:00100000:2.0:1788843139.403318:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843139.403382:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795668608 00000100:00100000:2.0:1788843139.403390:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795668608 00000100:00100000:1.0:1788843139.403528:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795669120 00000100:00100000:1.0:1788843139.403533:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795669120 00000100:00100000:1.0:1788843139.403571:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795668736 00000100:00100000:1.0:1788843139.403574:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795668736 00000100:00100000:1.0:1788843139.403587:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795668864 00000100:00100000:1.0:1788843139.403589:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795668864 00000100:00100000:1.0:1788843139.403605:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788843139.403612:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795669120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843139.403665:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795669120:12345-0@lo:400:kworker.0 Request processed in 52us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843139.403680:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788843139.403703:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788843139.403709:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795668736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843139.403742:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795668736:12345-0@lo:400:kworker.0 Request processed in 34us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843139.403748:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788843139.403759:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788843139.403764:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795668864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843139.403789:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795668864:12345-0@lo:400:kworker.0 Request processed in 25us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843139.403794:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1788843139.403810:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843139.403841:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51455c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795669120:0@lo:400:kworker.0 00000100:00100000:2.0:1788843139.404189:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788843139.404198:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795668608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843139.404256:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795668608:12345-0@lo:400:kworker.0 Request processed in 60us (1578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843139.404262:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788843139.404296:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795668992 00000100:00100000:2.0:1788843139.404300:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795668992 00000100:00100000:2.0:1788843139.404322:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795669248 00000100:00100000:2.0:1788843139.404324:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795669248 00000100:00100000:2.0:1788843139.404367:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788843139.404373:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795668992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843139.404403:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795668992:12345-0@lo:400:kworker.0 Request processed in 31us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843139.404408:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788843139.404418:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788843139.404839:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843139.404873:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51457b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795668864:0@lo:400:kworker.0 00000100:00100000:0.0:1788843139.404886:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51457100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795668736:0@lo:400:kworker.0 00000100:00100000:2.0:1788843139.405656:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795669248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843139.405735:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e848700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795669248:12345-0@lo:400:kworker.0 Request processed in 1304us (2474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843139.405743:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788843139.405786:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffb1880 x1875737795669248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843139.405798:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795669248:0@lo:400:kworker.0 00000100:00100000:1.0:1788843139.406288:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51456300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795668608:0@lo:400:kworker.0 00010000:00080000:1.0:1788843139.406308:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab51454000 x1875737795668992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843155 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843139.406319:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795668992:0@lo:400:kworker.0 00010000:00010000:2.0:1788843139.854007:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788843139.866208:0:10322:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1788843139.909231:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795669376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843139.909312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843139.909574:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795669376 00000100:00100000:3.0:1788843139.909584:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795669376 00000100:00100000:3.0:1788843139.909629:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788843139.909640:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795669376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843139.909675:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788843139.921771:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795669376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 12123us (12451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843139.921787:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788843139.924597:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffc0000 x1875737795669376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843155 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843139.924624:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795669376:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788843140.868788:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843141.896580:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843142.917610:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843143.312440:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843143.312478:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843143.312519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843143.312540:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843143.312561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843143.312595:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775714304 00000100:00100000:3.0:1788843143.312604:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775714304 00000100:00100000:3.0:1788843143.312875:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 219 00000100:00100000:3.0:1788843143.312887:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2357:x1875737775714304:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843143.313058:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2357:x1875737775714304:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 173us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843143.313066:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 219 00000100:00100000:3.0:1788843143.313210:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775714688 00000100:00100000:3.0:1788843143.313215:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775714688 00000100:00100000:3.0:1788843143.313248:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775714816 00000100:00100000:3.0:1788843143.313251:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775714816 00000100:00100000:3.0:1788843143.313275:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:3.0:1788843143.313283:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2357:x1875737775714688:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843143.313311:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2357:x1875737775714688:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 30us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843143.313319:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:3.0:1788843143.313331:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:3.0:1788843143.313337:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2357:x1875737775714816:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843143.313380:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2357:x1875737775714816:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 42us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843143.313531:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:3.0:1788843143.314255:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775714432 00000100:00100000:3.0:1788843143.314260:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775714432 00000100:00080000:0.0:1788843143.314536:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788843143.314541:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843143.314543:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843143.314607:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775714560 00000100:00100000:3.0:1788843143.314612:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775714560 00000100:00080000:0.0:1788843143.315246:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843143.315278:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00100000:3.0:1788843143.315292:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2357:x1875737775714432:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843143.315465:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2357:x1875737775714432:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 176us (3029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843143.316612:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:0.0:1788843143.316629:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2357:x1875737775714560:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843143.316688:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2357:x1875737775714560:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 66us (4146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843143.316696:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:3.0:1788843143.317037:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00100000:3.0:1788843143.499467:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795669504:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843143.499548:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843143.499836:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795669504 00000100:00100000:1.0:1788843143.499843:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795669504 00000100:00100000:1.0:1788843143.499922:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788843143.499931:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795669504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843143.499981:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843143.500027:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795669504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843143.500043:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788843143.500738:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788843143.500771:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffb3b80 x1875737795669504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843159 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843143.500791:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795669504:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788843143.940672:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843144.518079:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795669632:0@lo:400:kworker.0 00000100:00100000:0.0:1788843144.518162:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843144.518206:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795670144:0@lo:400:kworker.0 00000100:00100000:0.0:1788843144.518231:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843144.518258:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843144.518264:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795670016:0@lo:400:kworker.0 00000100:00100000:0.0:1788843144.518287:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843144.518314:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795669888:0@lo:400:kworker.0 00000100:00100000:0.0:1788843144.518369:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843144.518388:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788843144.518394:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795669760:0@lo:400:kworker.0 00000100:00100000:0.0:1788843144.518416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843144.518432:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795670272:0@lo:400:kworker.0 00000100:00100000:1.0:1788843144.518636:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795669632 00000100:00100000:1.0:1788843144.518644:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795669632 00000100:00100000:1.0:1788843144.518685:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1788843144.518704:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795669632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843144.518758:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795669632:12345-0@lo:400:kworker.0 Request processed in 65us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843144.518765:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788843144.518900:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843144.518935:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795670144 00000100:00100000:0.0:1788843144.518939:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795670144 00000100:00100000:0.0:1788843144.518979:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795669888 00000100:00100000:0.0:1788843144.518982:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795669888 00000100:00100000:0.0:1788843144.518996:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795669760 00000100:00100000:0.0:1788843144.518998:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795669760 00000100:00100000:0.0:1788843144.519010:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788843144.519016:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795670144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843144.519057:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795670144:12345-0@lo:400:kworker.0 Request processed in 41us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843144.519064:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788843144.519077:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788843144.519083:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795669888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843144.519391:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795669888:12345-0@lo:400:kworker.0 Request processed in 31us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843144.519400:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788843144.519414:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788843144.519420:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795669760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843144.519540:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795670016 00000100:00100000:1.0:1788843144.519544:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795670016 00000100:00100000:1.0:1788843144.519566:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795670272 00000100:00100000:1.0:1788843144.519568:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795670272 00000100:00100000:1.0:1788843144.519589:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788843144.519595:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795670016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843144.522931:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788843144.522978:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795670272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843144.525646:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795670016:12345-0@lo:400:kworker.0 Request processed in 6044us (7351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843144.525658:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788843144.526072:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffb3480 x1875737795670016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843144.526087:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795670016:0@lo:400:kworker.0 00000100:00100000:0.0:1788843144.526737:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795669760:12345-0@lo:400:kworker.0 Request processed in 6807us (7809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843144.526761:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1788843144.526788:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843144.526794:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843144.526836:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795669760:0@lo:400:kworker.0 00000100:00100000:0.0:1788843144.526850:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795669888:0@lo:400:kworker.0 00000100:00100000:1.0:1788843144.526911:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795669632:0@lo:400:kworker.0 00000100:00100000:1.0:1788843144.526923:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795670144:0@lo:400:kworker.0 00000100:00100000:3.0:1788843144.527223:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795670272:12345-0@lo:400:kworker.0 Request processed in 4279us (8321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843144.527231:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788843144.527753:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffb0700 x1875737795670272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843160 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843144.527765:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795670272:0@lo:400:kworker.0 00010000:00010000:3.0:1788843144.965518:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843145.029254:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843145.029278:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795670400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843145.029370:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843145.029482:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795670400 00000100:00100000:1.0:1788843145.029490:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795670400 00000100:00100000:1.0:1788843145.029548:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788843145.029568:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795670400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843145.029603:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843145.029654:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795670400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843145.029661:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788843145.030384:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffc2d80 x1875737795670400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843161 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843145.030404:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795670400:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788843145.988544:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843147.012554:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843148.036973:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843148.431745:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843148.431804:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843148.431869:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843148.431900:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843148.431937:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843148.431973:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775715072 00000100:00100000:1.0:1788843148.431983:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775715200 00000100:00100000:3.0:1788843148.431986:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775715072 00000100:00100000:1.0:1788843148.431990:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775715200 00000100:00100000:1.0:1788843148.432081:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 70 00000100:00100000:1.0:1788843148.432095:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775715200:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843148.432097:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775715328 00000100:00100000:0.0:1788843148.432104:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775715328 00000100:00100000:0.0:1788843148.432142:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775715456 00000100:00100000:0.0:1788843148.432146:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775715456 00000100:00100000:0.0:1788843148.432190:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:0.0:1788843148.432204:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775715328:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843148.432205:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775715200:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 109us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843148.432231:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 70 00000100:00100000:0.0:1788843148.432245:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775715328:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 47us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843148.432253:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:0.0:1788843148.432270:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:0.0:1788843148.432276:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775715456:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843148.432302:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775715456:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843148.432303:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775714944 00000100:00100000:2.0:1788843148.432307:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775714944 00000100:00100000:0.0:1788843148.432309:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:2.0:1788843148.432367:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 221 00000100:00100000:2.0:1788843148.432376:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2359:x1875737775714944:12345-192.168.203.29@tcp:400:kworker.0 00000100:00080000:0.0:1788843148.432380:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843148.432384:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843148.432395:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843148.432404:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2359:x1875737775714944:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 30us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843148.432410:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 221 00000100:00100000:3.0:1788843148.437284:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 71 00000100:00100000:3.0:1788843148.437309:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2359:x1875737775715072:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843148.437458:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2359:x1875737775715072:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 150us (5718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843148.437466:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 71 00000100:00100000:0.0:1788843148.613768:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843148.613801:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795670528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843148.613904:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843148.614188:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795670528 00000100:00100000:1.0:1788843148.614198:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795670528 00000100:00100000:1.0:1788843148.614275:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788843148.614286:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795670528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843148.614333:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843148.614415:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795670528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843148.614423:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788843148.614485:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffb0380 x1875737795670528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843164 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843148.614528:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795670528:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788843148.615302:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788843149.061166:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843149.637087:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795670912:0@lo:400:kworker.0 00000100:00100000:3.0:1788843149.637157:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843149.637214:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788843149.637220:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795670784:0@lo:400:kworker.0 00000100:00100000:3.0:1788843149.637243:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843149.637261:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795671296:0@lo:400:kworker.0 00000100:00100000:3.0:1788843149.637283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843149.637318:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795670912 00000100:00100000:3.0:1788843149.637325:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795670912 00000100:00100000:3.0:1788843149.637408:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795670784 00000100:00100000:3.0:1788843149.637412:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795670784 00000100:00100000:3.0:1788843149.637432:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788843149.637450:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795670912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843149.637500:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795670912:12345-0@lo:400:kworker.0 Request processed in 61us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843149.637507:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788843149.637523:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788843149.637529:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795670784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843149.637553:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795670784:12345-0@lo:400:kworker.0 Request processed in 25us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843149.637560:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788843149.637596:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795671296 00000100:00100000:3.0:1788843149.637600:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795671296 00000100:00100000:3.0:1788843149.637627:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788843149.637633:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795671296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843149.637667:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795671296:12345-0@lo:400:kworker.0 Request processed in 35us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843149.637672:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788843149.637686:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843149.637691:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843149.637730:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795670784:0@lo:400:kworker.0 00010000:00080000:3.0:1788843149.637742:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab600bfb80 x1875737795671296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843149.637751:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795671296:0@lo:400:kworker.0 00000100:00100000:3.0:1788843149.637760:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795670912:0@lo:400:kworker.0 00000100:00100000:2.0:1788843149.637957:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795671040:0@lo:400:kworker.0 00000100:00100000:2.0:1788843149.637989:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843149.638035:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788843149.638041:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795670656:0@lo:400:kworker.0 00000100:00100000:2.0:1788843149.638067:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843149.638089:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795671168:0@lo:400:kworker.0 00000100:00100000:2.0:1788843149.638117:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843149.639592:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795671168 00000100:00100000:1.0:1788843149.639604:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795671168 00000100:00100000:1.0:1788843149.639679:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788843149.639688:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795671168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843149.639771:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795671168:12345-0@lo:400:kworker.0 Request processed in 84us (1653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843149.639778:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788843149.639835:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795671168:0@lo:400:kworker.0 00000100:00080000:2.0:1788843149.640040:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843149.640326:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795671040 00000100:00100000:3.0:1788843149.640331:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795671040 00000100:00100000:3.0:1788843149.640397:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788843149.640405:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795671040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843149.640469:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795671040:12345-0@lo:400:kworker.0 Request processed in 65us (2479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843149.640476:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788843149.640495:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795670656 00000100:00100000:3.0:1788843149.640499:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795670656 00000100:00100000:3.0:1788843149.640524:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788843149.640531:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795670656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843149.640562:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795670656:12345-0@lo:400:kworker.0 Request processed in 32us (2494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843149.640581:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788843149.640738:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795670656:0@lo:400:kworker.0 00010000:00080000:1.0:1788843149.640755:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffc1f80 x1875737795671040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843165 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843149.640766:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795671040:0@lo:400:kworker.0 00010000:00010000:2.0:1788843150.084641:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843150.162811:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843150.162832:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795671424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843150.162907:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843150.162983:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795671424 00000100:00100000:2.0:1788843150.162989:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795671424 00000100:00100000:2.0:1788843150.163026:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788843150.163033:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795671424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788843150.163077:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788843150.163117:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795671424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843150.163124:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1788843150.163163:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab77b7d880 x1875737795671424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843166 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843150.163180:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795671424:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788843151.109544:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843152.132563:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843153.160623:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843153.553600:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843153.553658:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843153.553996:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775715712 00000100:00100000:0.0:1788843153.554010:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775715712 00000100:00100000:0.0:1788843153.554100:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 75 00000100:00100000:0.0:1788843153.554115:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775715712:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843153.554198:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775715712:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 86us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843153.554205:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 75 00000100:00080000:3.0:1788843153.554502:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843153.554523:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775715584 00000100:00100000:2.0:1788843153.554530:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775715584 00000100:00100000:2.0:1788843153.554573:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 223 00000100:00100000:2.0:1788843153.554581:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2359:x1875737775715584:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843153.554630:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2359:x1875737775715584:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 49us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843153.554637:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 223 00000100:00100000:3.0:1788843153.556469:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843153.556509:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843153.556562:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843153.556592:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775715968 00000100:00100000:3.0:1788843153.556600:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775715968 00000100:00100000:3.0:1788843153.556647:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775716096 00000100:00100000:3.0:1788843153.556650:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775716096 00000100:00100000:3.0:1788843153.556675:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:3.0:1788843153.556686:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2355:x1875737775715968:12345-192.168.203.29@tcp:9:kworker.0 00000020:00000080:3.0:1788843153.556715:0:6692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914d78 00000100:00080000:3.0:1788843153.556724:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8dab7fcb1000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788843153.556762:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788843153.557711:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+2:2355:x1875737775715968:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 1024us (1197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843153.557721:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:3.0:1788843153.557743:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:3.0:1788843153.557752:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2355:x1875737775716096:12345-192.168.203.29@tcp:9:kworker.0 00000020:00000080:3.0:1788843153.557771:0:6692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914d71 00000100:00080000:3.0:1788843153.557778:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8dab77ab3800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788843153.557804:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788843153.558099:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775715840 00000100:00100000:0.0:1788843153.558105:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775715840 00000100:00100000:0.0:1788843153.558158:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 76 00000100:00100000:0.0:1788843153.558166:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775715840:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843153.558205:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775715840:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 40us (1746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843153.558213:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 76 00000100:00080000:2.0:1788843153.559109:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843153.559116:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788843153.559119:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788843153.559211:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843153.559229:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843153.559434:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+2:2355:x1875737775716096:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 1678us (2884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843153.559454:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:0.0:1788843153.734745:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843153.734771:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795671552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843153.734853:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843153.735052:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795671552 00000100:00100000:1.0:1788843153.735064:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795671552 00000100:00100000:1.0:1788843153.735179:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788843153.735192:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795671552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843153.735234:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843153.735289:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795671552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843153.735298:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788843153.737160:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788843153.751273:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffb0380 x1875737795671552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843169 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843153.751320:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795671552:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788843154.181829:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843154.762398:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795672064:0@lo:400:kworker.0 00000100:00100000:1.0:1788843154.762481:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843154.762545:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788843154.762551:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795671680:0@lo:400:kworker.0 00000100:00100000:1.0:1788843154.762581:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843154.762604:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795672192:0@lo:400:kworker.0 00000100:00100000:1.0:1788843154.762627:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843154.762654:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795671808:0@lo:400:kworker.0 00000100:00100000:1.0:1788843154.762676:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843154.762694:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795672320:0@lo:400:kworker.0 00000100:00100000:1.0:1788843154.762713:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843154.762730:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788843154.762736:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795671936:0@lo:400:kworker.0 00000100:00100000:1.0:1788843154.762756:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843154.762787:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795672064 00000100:00100000:1.0:1788843154.762794:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795672064 00000100:00100000:1.0:1788843154.763284:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795672320 00000100:00100000:1.0:1788843154.763289:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795672320 00000100:00100000:1.0:1788843154.763319:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788843154.763329:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795672064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843154.763428:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795672064:12345-0@lo:400:kworker.0 Request processed in 99us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843154.763435:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788843154.763469:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788843154.763476:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795672320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843154.763509:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795672320:12345-0@lo:400:kworker.0 Request processed in 34us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843154.763514:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788843154.763534:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795671680 00000100:00100000:1.0:1788843154.763538:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795671680 00000100:00100000:1.0:1788843154.763563:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788843154.763568:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795671680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843154.763596:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795671680:12345-0@lo:400:kworker.0 Request processed in 28us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843154.763602:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:1.0:1788843154.763628:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795672192 00000100:00100000:1.0:1788843154.763632:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795672192 00000100:00100000:1.0:1788843154.763661:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795671808 00000100:00100000:1.0:1788843154.763664:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795671808 00000100:00100000:1.0:1788843154.763674:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795671936 00000100:00100000:1.0:1788843154.763676:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795671936 00000100:00100000:1.0:1788843154.763689:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788843154.764317:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795672192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843154.764397:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795672192:12345-0@lo:400:kworker.0 Request processed in 701us (1768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843154.764532:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788843154.764551:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788843154.764558:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795671808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843154.764588:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795671808:12345-0@lo:400:kworker.0 Request processed in 31us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843154.764603:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788843154.764616:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788843154.764622:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795671936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843154.764650:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795671936:12345-0@lo:400:kworker.0 Request processed in 29us (1893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843154.764655:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:1.0:1788843154.764688:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843154.764694:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843154.764737:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795671936:0@lo:400:kworker.0 00000100:00100000:1.0:1788843154.764748:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795671808:0@lo:400:kworker.0 00010000:00080000:1.0:1788843154.764761:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffb2680 x1875737795672320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843154.764771:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795672320:0@lo:400:kworker.0 00000100:00100000:1.0:1788843154.766451:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795671680:0@lo:400:kworker.0 00000100:00100000:1.0:1788843154.766474:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795672192:0@lo:400:kworker.0 00010000:00080000:1.0:1788843154.766489:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffb1c00 x1875737795672064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843170 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843154.766501:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795672064:0@lo:400:kworker.0 00010000:00010000:0.0:1788843155.207569:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843155.273287:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795672448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843155.273384:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843155.273467:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795672448 00000100:00100000:0.0:1788843155.273476:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795672448 00000100:00100000:0.0:1788843155.273535:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788843155.273545:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795672448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843155.273584:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843155.273630:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795672448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843155.273637:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1788843155.273681:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7fc78a80 x1875737795672448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843171 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843155.273701:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795672448:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788843155.832953:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b6d1c4e8-7f8e-438b-8c74-80bf75c52b59 00000020:00000080:2.0:1788843155.833093:0:6719:0:(genops.c:885:class_export_put()) final put ffff8dab7fcb0800/b6d1c4e8-7f8e-438b-8c74-80bf75c52b59 00000020:00000080:1.0:1788843155.852601:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7fcb0800/b6d1c4e8-7f8e-438b-8c74-80bf75c52b59 for lustre-OST0000 00000020:00000080:2.0:1788843155.854116:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab7fcb1000 for lustre-OST0000 00010000:00010000:2.0:1788843156.228785:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843157.253429:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788843157.910794:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b6d1c4e8-7f8e-438b-8c74-80bf75c52b59 00000020:00000080:0.0:1788843157.910806:0:7650:0:(genops.c:885:class_export_put()) final put ffff8dab77ab7800/b6d1c4e8-7f8e-438b-8c74-80bf75c52b59 00000020:00000080:3.0:1788843157.911525:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab77ab7800/b6d1c4e8-7f8e-438b-8c74-80bf75c52b59 for lustre-OST0001 00000020:00000080:3.0:1788843157.913908:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab77ab3800 for lustre-OST0001 00010000:00010000:2.0:1788843158.277523:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843158.675181:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843158.675223:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843158.675261:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843158.675402:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775716224 00000100:00100000:3.0:1788843158.675413:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775716224 00000100:00100000:3.0:1788843158.675467:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 225 00000100:00100000:3.0:1788843158.675478:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2357:x1875737775716224:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843158.675565:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2357:x1875737775716224:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 77us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843158.675573:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 225 00000100:00100000:0.0:1788843158.675805:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775716480 00000100:00100000:0.0:1788843158.675810:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775716480 00000100:00100000:0.0:1788843158.675858:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775716352 00000100:00100000:0.0:1788843158.675862:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775716352 00000100:00100000:0.0:1788843158.675893:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 80 00000100:00100000:0.0:1788843158.675900:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2357:x1875737775716480:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843158.675936:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2357:x1875737775716480:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 37us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843158.675942:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 80 00000100:00100000:0.0:1788843158.675955:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00100000:0.0:1788843158.675961:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2357:x1875737775716352:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843158.675986:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2357:x1875737775716352:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 24us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843158.675992:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00080000:3.0:1788843158.681201:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843158.853755:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843158.853780:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795672576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843158.853862:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843158.856794:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795672576 00000100:00100000:1.0:1788843158.856813:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795672576 00000100:00100000:1.0:1788843158.856904:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788843158.856915:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795672576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843158.856956:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843158.857109:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795672576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 196us (3246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843158.857116:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788843158.857249:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffb0380 x1875737795672576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843174 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843158.857291:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795672576:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788843158.857424:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788843159.304982:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788843159.779063:0:11023:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788843159.882949:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795672704:0@lo:400:kworker.0 00000100:00100000:1.0:1788843159.883061:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843159.884442:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843159.884463:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795673088:0@lo:400:kworker.0 00000100:00100000:1.0:1788843159.884550:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843159.884630:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795672704 00000100:00100000:1.0:1788843159.884640:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795672704 00000100:00100000:1.0:1788843159.884706:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788843159.884717:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795672704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843159.884992:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795672704:12345-0@lo:400:kworker.0 Request processed in 275us (1930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843159.885000:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788843159.885048:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795673088 00000100:00100000:1.0:1788843159.885053:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795673088 00000100:00100000:1.0:1788843159.885084:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788843159.885092:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795673088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843159.885205:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795673088:12345-0@lo:400:kworker.0 Request processed in 114us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843159.885213:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788843159.885284:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab77b7d180 x1875737795673088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843159.885300:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795673088:0@lo:400:kworker.0 00000100:00100000:1.0:1788843159.885311:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795672704:0@lo:400:kworker.0 00000100:00100000:2.0:1788843159.887531:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843159.887557:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795673216:0@lo:400:kworker.0 00000100:00100000:2.0:1788843159.887638:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843159.887713:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795672832:0@lo:400:kworker.0 00000100:00100000:2.0:1788843159.887742:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843159.887761:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795673344:0@lo:400:kworker.0 00000100:00100000:2.0:1788843159.887787:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843159.887812:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843159.887819:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795672960:0@lo:400:kworker.0 00000100:00100000:2.0:1788843159.887844:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843159.887886:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795673216 00000100:00100000:2.0:1788843159.887896:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795673216 00000100:00100000:2.0:1788843159.887991:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795672832 00000100:00100000:2.0:1788843159.887995:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795672832 00000100:00100000:2.0:1788843159.888006:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795672960 00000100:00100000:2.0:1788843159.888009:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795672960 00000100:00100000:2.0:1788843159.888026:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788843159.888035:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795673216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843159.888099:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795673216:12345-0@lo:400:kworker.0 Request processed in 64us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843159.888107:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788843159.888128:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788843159.888134:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795672832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843159.888169:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795672832:12345-0@lo:400:kworker.0 Request processed in 35us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843159.888175:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788843159.888187:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788843159.888194:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795672960:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788843159.888409:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843159.888430:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795673344 00000100:00100000:0.0:1788843159.888434:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795673344 00000100:00100000:0.0:1788843159.888480:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788843159.888488:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795673344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843159.888529:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795673344:12345-0@lo:400:kworker.0 Request processed in 44us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843159.888536:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:1.0:1788843159.888683:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843159.889213:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795672960:12345-0@lo:400:kworker.0 Request processed in 1016us (1365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843159.889456:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788843159.889574:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795673216:0@lo:400:kworker.0 00000100:00100000:2.0:1788843159.889630:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795672960:0@lo:400:kworker.0 00000100:00100000:2.0:1788843159.889644:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795672832:0@lo:400:kworker.0 00010000:00080000:2.0:1788843159.889661:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab77b7e300 x1875737795673344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843175 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843159.889672:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795673344:0@lo:400:kworker.0 00010000:00010000:2.0:1788843160.326634:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843160.389809:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795673472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843160.389909:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843160.390384:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795673472 00000100:00100000:1.0:1788843160.390396:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795673472 00000100:00100000:1.0:1788843160.391469:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788843160.391496:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795673472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843160.391860:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843160.391985:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795673472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 499us (2073us total) trans 0 rc 0/0 00010000:00080000:3.0:1788843160.392107:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab77b7e300 x1875737795673472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843176 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843160.392134:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795673472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843160.399655:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:2.0:1788843161.350164:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843162.373532:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843163.403691:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788843163.475427:0:11170:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7ef873f0 20000000:00000080:2.0:1788843163.475453:0:11170:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dab7d9b9000 uarg=0000000000000000 20000000:01000000:2.0:1788843163.475507:0:11170:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788843163.475515:0:11170:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788843163.475522:0:11170:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788843163.481466:0:11171:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:3.0:1788843163.481791:0:11170:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788843163.491528:0:11170:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788843163.491582:0:11170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914d7f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843163.491612:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab41532e00/0xc6b8ac1b0914d24 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708478b expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843163.491641:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914d32 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d2b expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843163.491648:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914d40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d39 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843163.491656:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b0914d4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d47 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843163.491663:0:11170:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab41532400/0xc6b8ac1b0914d63 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070847c3 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843163.491672:0:11170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914d7f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843163.491728:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab41532400/0xc6b8ac1b0914d63 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070847c3 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843163.491748:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab41532400/0xc6b8ac1b0914d63 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070847c3 expref: 12 pid: 5841 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843163.491839:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1875737795673600:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843163.492551:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b0914d4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914d47 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843163.492564:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b0914d4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d47 expref: 18 pid: 5839 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843163.492579:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1875737795673728:0@lo:104: 00000100:00100000:3.0:1788843163.492655:0:11170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788843163.492771:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914d40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914d39 expref: 18 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843163.492781:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914d40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d39 expref: 18 pid: 5841 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843163.492790:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1875737795673856:0@lo:104: 00000100:00100000:3.0:1788843163.492815:0:11170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788843163.498599:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914d32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914d2b expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843163.498624:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914d32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d2b expref: 18 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843163.498644:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1875737795673984:0@lo:104: 00000100:00100000:3.0:1788843163.498718:0:11170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843163.501546:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795673728 00000100:00100000:1.0:1788843163.501568:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795673728 00000100:00100000:1.0:1788843163.501639:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795673856 00000100:00100000:1.0:1788843163.501643:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795673856 00000100:00100000:1.0:1788843163.501667:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788843163.501679:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28cf63da-daee-485f-b466-4ec68876f732+4:11170:x1875737795673728:12345-0@lo:104: 00010000:00010000:1.0:1788843163.501705:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0914d47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914d4e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843163.501849:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788843163.501856:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28cf63da-daee-485f-b466-4ec68876f732+4:11170:x1875737795673728:12345-0@lo:104: Request processed in 181us (9202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843163.501865:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788843163.501931:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788843163.501940:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28cf63da-daee-485f-b466-4ec68876f732+3:11170:x1875737795673856:12345-0@lo:104: 00010000:00010000:1.0:1788843163.501951:0:5830:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914d40 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843163.501993:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788843163.501999:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:28cf63da-daee-485f-b466-4ec68876f732+3:11170:x1875737795673856:12345-0@lo:104: Request processed in 60us (9184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843163.502005:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788843163.503409:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00010000:00010000:2.0:1788843163.503457:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843163.503467:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0914d47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914d4e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843163.503480:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4000 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:2.0:1788843163.503485:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0914d47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914d4e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843163.503495:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0914d47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914d4e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843163.503503:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0914d47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914d4e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843163.503509:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788843163.503575:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0914d47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914d4e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843163.503582:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843163.503612:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0914d47 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914d4e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843163.503618:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0914d47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914d4e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843163.503653:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843163.503657:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914d40 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843163.503662:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88400 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:2.0:1788843163.503666:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d39 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914d40 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843163.503672:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914d40 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843163.503678:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914d40 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843163.503684:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788843163.503699:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914d40 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843163.503704:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788843163.503711:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d39 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914d40 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843163.503716:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d39 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914d40 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843163.503726:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843163.503728:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843163.503729:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843163.503737:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843163.503770:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795674112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843163.503832:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843163.503901:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843163.503907:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795674240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843163.504283:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775716608 00000100:00100000:1.0:1788843163.504293:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775716608 00010000:00010000:1.0:1788843163.504335:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab41532400/0xc6b8ac1b0914d63 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070847c3 expref: 13 pid: 5841 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843163.504394:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795674112 00000100:00100000:1.0:1788843163.504398:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795674112 00010000:00010000:1.0:1788843163.504413:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b0914d4e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d47 expref: 19 pid: 5839 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843163.504438:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:1.0:1788843163.504449:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51553450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2359:x1875737775716608:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843163.504470:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843163.504475:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab41532400/0xc6b8ac1b0914d63 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070847c3 expref: 13 pid: 5841 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843163.504491:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab41532400/0xc6b8ac1b0914d63 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070847c3 expref: 13 pid: 5841 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843163.504516:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843163.506447:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795673984 00000100:00100000:0.0:1788843163.506466:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795673984 00000100:00100000:0.0:1788843163.506547:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788843163.506558:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28cf63da-daee-485f-b466-4ec68876f732+3:11170:x1875737795673984:12345-0@lo:104: 00010000:00010000:0.0:1788843163.506580:0:6717:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88a00/0xc6b8ac1b0914d2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914d32 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843163.507008:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51553450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2359:x1875737775716608:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 2555us (3660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843163.507019:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:1.0:1788843163.507094:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788843163.507106:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795674112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843163.507121:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843163.507131:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b0914d4e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d47 expref: 19 pid: 5839 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843163.507145:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b0914d4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d47 expref: 19 pid: 5839 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843163.507172:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843163.507235:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795674112:12345-0@lo:103:ldlm_bl.0 Request processed in 133us (3402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843163.507241:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788843163.508037:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843163.508143:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795674112:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843163.508200:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795674240 00000100:00100000:2.0:1788843163.508208:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795674240 00010000:00010000:2.0:1788843163.508254:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914d40 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d39 expref: 19 pid: 5841 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843163.508292:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788843163.508299:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795674240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843163.508314:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843163.508319:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914d40 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d39 expref: 19 pid: 5841 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843163.508331:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914d40 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d39 expref: 19 pid: 5841 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843163.508377:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843163.508417:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795674240:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843163.508424:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788843163.509226:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795674240:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843163.510997:0:11170:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab41532e00/0xc6b8ac1b0914d24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708478b expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843163.511025:0:11170:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab41532e00/0xc6b8ac1b0914d24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708478b expref: 12 pid: 5841 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843163.511042:0:11170:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1875737795674368:192.168.203.29@tcp:104: 00000100:00100000:3.0:1788843163.511126:0:11170:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab50c45180 going to sleep for 11 seconds 00010000:00010000:3.0:1788843163.511155:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab41532400/0xc6b8ac1b0914d63 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070847c3 expref: 12 pid: 5841 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843163.511176:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1875737795673600:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843163.511213:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7ff88200/0xc6b8ac1b0914d4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914d47 expref: 18 pid: 5839 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843163.511224:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1875737795673728:0@lo:104: 00010000:00010000:3.0:1788843163.511241:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0914d40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914d39 expref: 17 pid: 5841 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843163.511250:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcace00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1875737795673856:0@lo:104: 00000100:00100000:3.0:1788843163.511258:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1875737795673984:0@lo:104: 00010000:00010000:0.0:1788843163.512224:0:6717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788843163.512240:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcac000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28cf63da-daee-485f-b466-4ec68876f732+3:11170:x1875737795673984:12345-0@lo:104: Request processed in 5681us (13519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843163.512252:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788843163.514827:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843163.514977:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775716736 00000100:00100000:0.0:1788843163.514989:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775716736 00010000:00010000:0.0:1788843163.515035:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab41532e00/0xc6b8ac1b0914d24 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708478b expref: 12 pid: 5841 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843163.515105:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:0.0:1788843163.515116:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:2359:x1875737775716736:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843163.515135:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843163.515141:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab41532e00/0xc6b8ac1b0914d24 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708478b expref: 12 pid: 5841 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843163.515154:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab41532e00/0xc6b8ac1b0914d24 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708478b expref: 12 pid: 5841 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843163.515183:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843163.515248:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:2359:x1875737775716736:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 134us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843163.515256:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 28 00010000:00010000:3.0:1788843163.515572:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab41532e00/0xc6b8ac1b0914d24 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708478b expref: 11 pid: 5841 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843163.515593:0:11170:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11170:1875737795674368:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843163.515634:0:11170:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914d7f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843163.517186:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843163.517206:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88a00/0xc6b8ac1b0914d2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914d32 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843163.517249:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88a00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:2.0:1788843163.517255:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88a00/0xc6b8ac1b0914d2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914d32 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843163.517267:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88a00/0xc6b8ac1b0914d2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914d32 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843163.517275:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88a00/0xc6b8ac1b0914d2b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914d32 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843163.517281:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788843163.517658:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88a00/0xc6b8ac1b0914d2b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914d32 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843163.517667:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843163.517702:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88a00/0xc6b8ac1b0914d2b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914d32 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843163.517711:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88a00/0xc6b8ac1b0914d2b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914d32 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843163.517736:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843163.517738:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843163.517740:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843163.517783:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843163.517821:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795674496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843163.517932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843163.518207:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795674496 00000100:00100000:0.0:1788843163.518218:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795674496 00010000:00010000:0.0:1788843163.518264:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914d32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d2b expref: 17 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843163.518305:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788843163.518315:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28cf63da-daee-485f-b466-4ec68876f732+17:3305:x1875737795674496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843163.518331:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843163.518770:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914d32 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d2b expref: 17 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843163.518789:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914d32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d2b expref: 17 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843163.518815:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914d32 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914d2b expref: 17 pid: 5840 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843163.518833:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914d7f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843163.518852:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914d7f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843163.518873:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914d7f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843163.518881:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914d7f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843163.518890:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914d7f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843163.518896:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914d7f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843163.519073:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843163.519078:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914d7f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843163.519086:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914d7f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843163.519102:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914d7f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843163.519114:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843163.519188:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:28cf63da-daee-485f-b466-4ec68876f732+16:3305:x1875737795674496:12345-0@lo:103:ldlm_bl.0 Request processed in 872us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843163.519198:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788843163.519252:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795674496:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843163.520736:0:11170:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914d7f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843163.520755:0:11170:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914d7f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843163.520764:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914d7f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843163.807460:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843163.807529:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843163.807624:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775716992 00000100:00100000:0.0:1788843163.807638:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775716992 00000100:00100000:0.0:1788843163.807754:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775716864 00000100:00100000:0.0:1788843163.807758:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775716864 00000100:00100000:3.0:1788843163.807770:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:3.0:1788843163.807809:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2357:x1875737775716992:12345-192.168.203.29@tcp:400:kworker.0 00000100:00080000:1.0:1788843163.807819:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843163.807939:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2357:x1875737775716992:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 135us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843163.808111:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 86 00000100:00100000:0.0:1788843163.808122:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2357:x1875737775716864:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843163.808174:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2357:x1875737775716864:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 55us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843163.808182:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 86 00000100:00100000:3.0:1788843163.810899:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:0.0:1788843163.973379:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795674624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843163.973481:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843163.973706:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795674624 00000100:00100000:1.0:1788843163.973717:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795674624 00000100:00100000:1.0:1788843163.973826:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788843163.973838:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795674624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843163.973885:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843163.973951:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795674624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843163.973960:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788843163.974238:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788843163.974376:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffb0700 x1875737795674624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843179 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843163.974403:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795674624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788843164.420969:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788843164.868552:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788843164.868565:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab51a7d800 from 7 10000000:01000000:1.0:1788843164.868573:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788843164.868657:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0914d86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843164.868672:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0914d86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843164.868685:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0914d86 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843164.868723:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795674752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788843164.868835:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843164.868906:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6e76bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843164.869195:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795674752 00000100:00100000:3.0:1788843164.869207:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795674752 00000100:00100000:3.0:1788843164.869274:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788843164.869286:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+16:5844:x1875737795674752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843164.869303:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843164.869321:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab82055e00/0xc6b8ac1b0914d8d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914d86 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843164.875543:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab82055e00/0xc6b8ac1b0914d8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d86 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843164.875571:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab82055e00/0xc6b8ac1b0914d8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d86 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843164.875588:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82055e00, rc 0) 00000100:00100000:2.0:1788843164.877598:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795674752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 8297us (8747us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843164.877614:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788843164.878915:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795674752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843164.878955:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0914d86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d8d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843164.878970:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0914d86 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914d8d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843164.879086:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795674880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843164.879163:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843164.879282:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab43774b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843164.880466:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795674880 00000100:00100000:1.0:1788843164.880480:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795674880 00000100:00100000:0.0:1788843164.880692:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788843164.880705:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795674880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843164.881126:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795674880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 422us (1962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843164.881136:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788843164.881246:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc7bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795674880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843164.881307:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795675008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843164.881417:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843164.887126:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4936a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788843164.888523:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795675008 00000100:00100000:1.0:1788843164.888546:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795675008 00000100:00100000:1.0:1788843164.888631:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788843164.888645:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795675008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843164.889112:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795675008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 467us (7692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843164.889122:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788843164.889290:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795675008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788843164.890466:0:11201:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788843164.893625:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788843164.893672:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843164.893691:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0914d86 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d8d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843164.893707:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0914d86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d8d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843164.893722:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788843164.893726:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab7395d800 from 7 10000000:01000000:2.0:1788843164.893728:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788843164.893861:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843164.893871:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843164.893883:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d94 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843164.893920:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795675136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788843164.894019:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843164.894142:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4936a240 going to sleep for 11 seconds 00000100:00100000:1.0:1788843164.895300:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795675136 00000100:00100000:1.0:1788843164.895316:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795675136 00000100:00100000:0.0:1788843164.896567:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788843164.896585:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795675136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843164.896610:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843164.896634:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0914d9b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914d94 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843164.896671:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0914d9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d94 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843164.896684:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0914d9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d94 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843164.896715:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4c00, rc 0) 00000100:00100000:0.0:1788843164.896929:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795675136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 347us (2908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843164.896938:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788843164.897125:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795675136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843164.897152:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d9b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843164.897164:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d94 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914d9b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843164.897282:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795675264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843164.897326:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843164.897422:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4936a240 going to sleep for 11 seconds 00000100:00100000:3.0:1788843164.897516:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795675264 00000100:00100000:3.0:1788843164.897525:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795675264 00000100:00100000:3.0:1788843164.897574:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788843164.897583:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795675264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843164.898017:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795675264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 434us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843164.898025:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788843164.898137:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795675264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843164.898179:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795675392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843164.898232:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843164.898263:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4936a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788843164.898372:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795675392 00000100:00100000:0.0:1788843164.898379:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795675392 00000100:00100000:0.0:1788843164.898410:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788843164.898418:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795675392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843164.898616:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795675392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843164.898624:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788843164.898714:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795675392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788843164.901070:0:11202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788843164.901698:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788843164.901736:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788843164.901830:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d94 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d9b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843164.901846:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d9b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843164.901862:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788843164.901866:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab71a20000 from 7 10000000:01000000:0.0:1788843164.901870:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843164.901932:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914da2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843164.901941:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914da2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843164.901979:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914da2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843164.902011:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795675520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843164.902101:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843164.902157:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab43774e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843164.902265:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795675520 00000100:00100000:3.0:1788843164.902275:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795675520 00000100:00100000:3.0:1788843164.902365:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788843164.902377:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795675520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843164.902399:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843164.902414:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914da9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914da2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843164.902441:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914da2 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843164.902453:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914da2 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843164.902463:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82054a00, rc 0) 00000100:00100000:3.0:1788843164.902514:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795675520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843164.902521:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788843164.902716:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795675520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843164.902733:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914da2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914da9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843164.902743:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914da2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914da9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843164.902880:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795675648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843164.902916:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843164.902986:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab43774e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843164.906273:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795675648 00000100:00100000:3.0:1788843164.906297:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795675648 00000100:00100000:3.0:1788843164.906405:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788843164.906418:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795675648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843164.907729:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795675648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1304us (4802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843164.907744:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788843164.912044:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795675648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843164.912159:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795675776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843164.912261:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843164.912315:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab43774e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843164.913659:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795675776 00000100:00100000:2.0:1788843164.913679:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795675776 00000100:00100000:2.0:1788843164.913747:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788843164.913760:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795675776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843164.914093:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795675776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 334us (1831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843164.914102:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788843164.914274:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc78700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795675776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788843164.915290:0:11204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788843164.916056:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788843164.916087:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788843164.916100:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914da2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914da9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843164.916122:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914da2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914da9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843164.946628:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843164.946679:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775717120 00000100:00100000:1.0:1788843164.946692:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775717120 00000100:00100000:1.0:1788843164.946759:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 236 00000100:00100000:1.0:1788843164.946795:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+11:5598:x1875737775717120:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843164.946820:0:5841:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843164.946844:0:5841:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab4933b000/0xc6b8ac1b0914db0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c6070847ed expref: -99 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843164.946883:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab4933b000/0xc6b8ac1b0914db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070847ed expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843164.946897:0:5841:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab4933b000/0xc6b8ac1b0914db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070847ed expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843164.946908:0:5841:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b000, rc 0) 00000100:00100000:1.0:1788843164.946984:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:5598:x1875737775717120:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 203us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843164.946993:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 236 00000100:00100000:1.0:1788843164.950231:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843164.950313:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775717248 00000100:00100000:3.0:1788843164.950326:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775717248 00000100:00100000:3.0:1788843164.950556:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 237 00000100:00100000:3.0:1788843164.950573:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:5598:x1875737775717248:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843164.950972:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48998850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:5598:x1875737775717248:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 402us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843164.953977:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 237 00000100:00100000:1.0:1788843164.962935:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843164.963597:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775717376 00000100:00100000:3.0:1788843164.963614:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775717376 00000100:00100000:3.0:1788843164.963686:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 238 00000100:00100000:3.0:1788843164.963700:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:5598:x1875737775717376:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843164.964034:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:5598:x1875737775717376:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 336us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843164.964043:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 238 00000100:00100000:1.0:1788843164.976994:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843164.977188:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775717504 00000100:00100000:3.0:1788843164.977204:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775717504 00000100:00100000:3.0:1788843164.977276:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 239 00000100:00100000:3.0:1788843164.977289:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:5598:x1875737775717504:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843164.977311:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843164.977551:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab82054200/0xc6b8ac1b0914db7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c6070847f4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843164.977593:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab82054200/0xc6b8ac1b0914db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070847f4 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843164.977607:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab82054200/0xc6b8ac1b0914db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070847f4 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843164.977618:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82054200, rc 0) 00000100:00100000:3.0:1788843164.977696:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48999c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:5598:x1875737775717504:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 409us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843164.977703:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 239 00000100:00100000:2.0:1788843164.980653:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843164.980801:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775717632 00000100:00100000:1.0:1788843164.980814:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775717632 00000100:00100000:1.0:1788843164.980922:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 240 00000100:00100000:1.0:1788843164.980936:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:5598:x1875737775717632:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843164.981303:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:5598:x1875737775717632:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 368us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843164.981311:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 240 00000100:00100000:1.0:1788843164.989758:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843164.993753:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775717760 00000100:00100000:2.0:1788843164.993774:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775717760 00000100:00100000:2.0:1788843164.993864:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 241 00000100:00100000:2.0:1788843164.993878:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:5598:x1875737775717760:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843164.994186:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:5598:x1875737775717760:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 309us (4440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843164.994204:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 241 00000100:00100000:3.0:1788843164.997692:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843165.000973:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795676032:0@lo:400:kworker.0 00000100:00100000:3.0:1788843165.001080:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843165.001157:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795675904:0@lo:400:kworker.0 00000100:00100000:3.0:1788843165.001178:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843165.001229:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795676032 00000100:00100000:3.0:1788843165.001238:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795676032 00000100:00100000:3.0:1788843165.001307:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795675904 00000100:00100000:3.0:1788843165.001309:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795675904 00000100:00100000:3.0:1788843165.001365:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788843165.001377:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795676032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843165.001896:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788843165.001908:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795675904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843165.001985:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795675904:12345-0@lo:400:kworker.0 Request processed in 81us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843165.001994:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788843165.002054:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795676160:0@lo:400:kworker.0 00000100:00100000:2.0:1788843165.002097:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843165.002132:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843165.002137:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795676288:0@lo:400:kworker.0 00000100:00100000:2.0:1788843165.002163:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843165.002188:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795676288 00000100:00100000:2.0:1788843165.002193:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795676288 00000100:00100000:2.0:1788843165.002221:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788843165.002226:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875737795676288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843165.002256:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875737795676288:12345-0@lo:400:kworker.0 Request processed in 30us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843165.002262:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788843165.002302:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795676288:0@lo:400:kworker.0 00000100:00100000:3.0:1788843165.002412:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795676032:12345-0@lo:400:kworker.0 Request processed in 1037us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843165.002495:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:3.0:1788843165.002520:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843165.003500:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795676416:0@lo:400:kworker.0 00000100:00100000:1.0:1788843165.003575:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843165.003661:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795676160 00000100:00100000:1.0:1788843165.003668:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795676160 00000100:00100000:1.0:1788843165.003730:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795676416 00000100:00100000:1.0:1788843165.003734:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795676416 00000100:00100000:1.0:1788843165.003759:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788843165.003768:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795676160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843165.003829:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795676160:12345-0@lo:400:kworker.0 Request processed in 62us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843165.003836:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788843165.003856:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788843165.003863:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795676416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843165.003895:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795676416:12345-0@lo:400:kworker.0 Request processed in 33us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843165.003902:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1788843165.003947:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7fc78000 x1875737795676416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843165.003962:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795676416:0@lo:400:kworker.0 00010000:00080000:1.0:1788843165.004004:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7fc78700 x1875737795676160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843165.004015:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795676160:0@lo:400:kworker.0 00000100:00100000:1.0:1788843165.004048:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795676032:0@lo:400:kworker.0 00000100:00100000:1.0:1788843165.004063:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795675904:0@lo:400:kworker.0 00000100:00080000:3.0:1788843165.004235:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843165.004242:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788843165.446623:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843165.515960:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795676544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843165.516044:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843165.516117:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795676544 00000100:00100000:3.0:1788843165.516125:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795676544 00000100:00100000:3.0:1788843165.516170:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788843165.516180:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795676544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843165.516215:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788843165.516266:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795676544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843165.516273:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788843165.516465:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab77b7e680 x1875737795676544/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843181 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843165.516486:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795676544:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788843166.469478:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843167.496251:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788843167.723035:0:11369:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788843168.516739:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843168.924235:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843168.924325:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843168.924480:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843168.928179:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775717888 00000100:00100000:3.0:1788843168.928205:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775717888 00000100:00100000:3.0:1788843168.928330:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 242 00000100:00100000:3.0:1788843168.928386:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2358:x1875737775717888:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843168.928499:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2358:x1875737775717888:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 157us (4277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843168.928508:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 242 00000100:00100000:0.0:1788843168.935465:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775718144 00000100:00100000:0.0:1788843168.935487:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775718144 00000100:00100000:0.0:1788843168.935601:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775718016 00000100:00100000:0.0:1788843168.935605:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775718016 00000100:00100000:0.0:1788843168.935645:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 90 00000100:00100000:0.0:1788843168.935656:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2358:x1875737775718144:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843168.935781:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2358:x1875737775718144:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 126us (11454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843168.935789:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 90 00000100:00100000:0.0:1788843168.935812:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 91 00000100:00100000:0.0:1788843168.935819:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775718016:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843168.935858:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775718016:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 39us (11379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843168.935865:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 91 00000100:00080000:3.0:1788843168.935992:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843169.098116:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795676672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843169.098227:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843169.098517:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795676672 00000100:00100000:0.0:1788843169.098527:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795676672 00000100:00100000:0.0:1788843169.098600:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788843169.098610:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795676672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843169.098654:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788843169.098765:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843169.103319:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795676672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4626us (5008us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843169.103378:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788843169.103923:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffb1880 x1875737795676672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843185 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843169.104144:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795676672:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788843169.542134:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843170.118655:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795676928:0@lo:400:kworker.0 00000100:00100000:3.0:1788843170.118735:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843170.118788:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795677440:0@lo:400:kworker.0 00000100:00100000:3.0:1788843170.118816:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843170.118856:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843170.118862:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795677056:0@lo:400:kworker.0 00000100:00100000:3.0:1788843170.118884:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843170.118924:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795676928 00000100:00100000:1.0:1788843170.118928:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795677056 00000100:00100000:3.0:1788843170.118931:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795676928 00000100:00100000:1.0:1788843170.118935:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795677056 00000100:00100000:2.0:1788843170.119022:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795676800:0@lo:400:kworker.0 00000100:00100000:2.0:1788843170.119057:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843170.119541:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788843170.119556:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795676928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843170.119626:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795676928:12345-0@lo:400:kworker.0 Request processed in 75us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843170.119634:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788843170.119652:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1788843170.121418:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843170.121476:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795677184:0@lo:400:kworker.0 00000100:00100000:0.0:1788843170.121572:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843170.121671:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795677056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843170.121732:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795677056:12345-0@lo:400:kworker.0 Request processed in 2074us (2846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843170.121741:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788843170.121830:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795677312:0@lo:400:kworker.0 00000100:00100000:2.0:1788843170.121869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843170.121875:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795677440 00000100:00100000:1.0:1788843170.121884:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795677440 00000100:00100000:2.0:1788843170.121930:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795676800 00000100:00100000:1.0:1788843170.121930:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795677184 00000100:00100000:1.0:1788843170.121933:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795677184 00000100:00100000:2.0:1788843170.121938:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795676800 00000100:00100000:1.0:1788843170.121955:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788843170.121965:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795677440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843170.121979:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1788843170.121990:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3305:x1875737795676800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843170.122003:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795677440:12345-0@lo:400:kworker.0 Request processed in 40us (3186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843170.122010:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788843170.122022:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788843170.122029:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795677184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843170.122043:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48998050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3305:x1875737795676800:12345-0@lo:400:kworker.0 Request processed in 55us (2985us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843170.122052:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788843170.122059:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795677184:12345-0@lo:400:kworker.0 Request processed in 29us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843170.122081:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788843170.122101:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795677312 00000100:00100000:2.0:1788843170.122107:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795677312 00000100:00100000:2.0:1788843170.122164:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788843170.122172:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795677312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843170.122222:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795677312:12345-0@lo:400:kworker.0 Request processed in 51us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843170.122229:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788843170.122286:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795676800:0@lo:400:kworker.0 00000100:00100000:2.0:1788843170.122309:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795677312:0@lo:400:kworker.0 00000100:00100000:2.0:1788843170.122411:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795677056:0@lo:400:kworker.0 00000100:00100000:2.0:1788843170.122425:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795676928:0@lo:400:kworker.0 00010000:00080000:2.0:1788843170.122440:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7c183480 x1875737795677440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843170.122452:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c183480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795677440:0@lo:400:kworker.0 00010000:00080000:0.0:1788843170.125263:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7c182680 x1875737795677184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843170.125282:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795677184:0@lo:400:kworker.0 00000100:00080000:0.0:1788843170.125329:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788843170.125335:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788843170.564822:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843170.630517:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843170.630541:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795677568:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843170.630622:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843170.630770:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795677568 00000100:00100000:2.0:1788843170.630779:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795677568 00000100:00100000:2.0:1788843170.630959:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788843170.630971:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795677568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788843170.631013:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788843170.631096:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795677568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843170.631104:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1788843170.631199:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab77b7d500 x1875737795677568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843186 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843170.631224:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795677568:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788843171.590134:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788843171.764151:0:11469:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 00:52:50 (1788843170) === 00000100:00100000:1.0:1788843172.116743:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843172.116842:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843172.117023:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775718272 00000100:00100000:2.0:1788843172.117035:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775718272 00000100:00100000:3.0:1788843172.117105:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775718400 00000100:00100000:3.0:1788843172.117111:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775718400 00000100:00100000:2.0:1788843172.117148:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:3.0:1788843172.117152:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:2.0:1788843172.117169:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2358:x1875737775718272:12345-192.168.203.29@tcp:41:mkdir.0 00000100:00100000:3.0:1788843172.117178:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:9684:x1875737775718400:12345-192.168.203.29@tcp:700:mkdir.0 00000004:00000024:2.0:1788843172.117226:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788843172.117252:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:9684:x1875737775718400:12345-192.168.203.29@tcp:700:mkdir.0 Request processed in 76us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843172.117260:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:2.0:1788843172.117312:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775718272:12345-192.168.203.29@tcp:41:mkdir.0 Request processed in 152us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843172.117320:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00080000:0.0:1788843172.117583:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843172.124995:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843172.125155:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775718656 00000100:00100000:2.0:1788843172.125165:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775718656 00000100:00100000:2.0:1788843172.125299:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:2.0:1788843172.125326:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:9684:x1875737775718656:12345-192.168.203.29@tcp:36:mkdir.0 00010000:00010000:2.0:1788843172.125451:0:7168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843172.125542:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab40030600/0xc6b8ac1b0914c9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084776 expref: 6 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.125571:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43ece700) 00010000:00010000:2.0:1788843172.125583:0:7168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843172.126035:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89c00/0xc6b8ac1b0914dbe lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.126051:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89c00/0xc6b8ac1b0914dbe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.126061:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89c00/0xc6b8ac1b0914dbe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.126080:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0914dc5 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.126087:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0914dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.126100:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0914dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843172.128111:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788843172.128153:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89c00/0xc6b8ac1b0914dbe lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.128164:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89c00/0xc6b8ac1b0914dbe lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.128182:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89c00/0xc6b8ac1b0914dbe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.128188:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff89c00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843172.128192:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89c00/0xc6b8ac1b0914dbe lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.128199:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89c00/0xc6b8ac1b0914dbe lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.128216:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910300) 00010000:00010000:2.0:1788843172.128220:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843172.128224:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89c00/0xc6b8ac1b0914dbe lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.128231:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89c00/0xc6b8ac1b0914dbe lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843172.128323:0:7168:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000042b9614f reply state 00000000ff0e1f73 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0914dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843172.128382:0:7168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788843172.128522:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+7:9684:x1875737775718656:12345-192.168.203.29@tcp:36:mkdir.0 Request processed in 3177us (4162us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788843172.128532:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00010000:00010000:2.0:1788843172.135837:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0914dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.135874:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0914dc5 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.135901:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0914dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.135908:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff89e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843172.135913:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0914dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.135923:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0914dc5 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.135947:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8dab54910100) 00010000:00010000:2.0:1788843172.135950:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843172.135962:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0914dc5 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.135969:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0914dc5 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843172.153060:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843172.153128:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775718784 00000100:00100000:1.0:1788843172.153137:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775718784 00000100:00100000:1.0:1788843172.153215:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:1.0:1788843172.153231:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:9685:x1875737775718784:12345-192.168.203.29@tcp:101:chmod.0 00010000:00010000:1.0:1788843172.153249:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843172.153277:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ba00/0xc6b8ac1b0914dcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070847fb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.153512:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a600/0xc6b8ac1b0914dd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.153527:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a600/0xc6b8ac1b0914dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.153546:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a600/0xc6b8ac1b0914dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843172.153589:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788843172.153593:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788843172.153638:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a600/0xc6b8ac1b0914dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.153665:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ba00/0xc6b8ac1b0914dcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070847fb expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.153691:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a600/0xc6b8ac1b0914dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070847fb expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.153719:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab61f39000) 00010000:00010000:1.0:1788843172.153722:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788843172.153726:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933a600, rc 0) 00000100:00100000:1.0:1788843172.153858:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:9685:x1875737775718784:12345-192.168.203.29@tcp:101:chmod.0 Request processed in 633us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843172.153874:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:3.0:1788843172.160446:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843172.160503:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775719040 00000100:00100000:0.0:1788843172.160513:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775719040 00000100:00100000:0.0:1788843172.160591:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:0.0:1788843172.160601:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:9685:x1875737775719040:12345-192.168.203.29@tcp:36:chmod.0 00010000:00010000:0.0:1788843172.160651:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843172.160699:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a600/0xc6b8ac1b0914dd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070847fb expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.160720:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab61f39000) 00010000:00010000:0.0:1788843172.160758:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843172.160809:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0914dda lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.160822:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0914dda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.160837:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0914dda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788843172.161266:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000951ead11 reply state 0000000012d020be transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0914dda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843172.161282:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788843172.161305:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788843172.162052:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+8:9685:x1875737775719040:12345-192.168.203.29@tcp:36:chmod.0 Request processed in 1446us (1608us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788843172.162062:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00010000:00010000:1.0:1788843172.168989:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0914dda lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.169007:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0914dda lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.169015:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0914dda lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.169021:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843172.169026:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0914dda lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.169034:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0914dda lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.169051:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43ece900) 00010000:00010000:1.0:1788843172.169055:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788843172.169060:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0914dda lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.169067:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0914dda lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843172.208673:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843172.208862:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775719168 00000100:00100000:1.0:1788843172.208873:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775719168 00000100:00100000:1.0:1788843172.208939:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:1.0:1788843172.208949:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:9686:x1875737775719168:12345-192.168.203.29@tcp:101:chown.0 00010000:00010000:1.0:1788843172.208975:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843172.208998:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0914de1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084802 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.209072:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0914de8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.209090:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0914de8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.209102:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0914de8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843172.209138:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788843172.209141:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788843172.209179:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0914de8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.209205:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0914de1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084802 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.209225:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0914de8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084802 expref: 8 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.209235:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab61f39900) 00010000:00010000:1.0:1788843172.209250:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788843172.209254:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933a000, rc 0) 00000100:00100000:1.0:1788843172.209429:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+8:9686:x1875737775719168:12345-192.168.203.29@tcp:101:chown.0 Request processed in 481us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843172.209437:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:2.0:1788843172.223475:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843172.226355:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775719296 00000100:00100000:3.0:1788843172.226375:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775719296 00000100:00100000:3.0:1788843172.226935:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:3.0:1788843172.226950:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+8:9686:x1875737775719296:12345-192.168.203.29@tcp:101:chown.0 00010000:00010000:3.0:1788843172.226978:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843172.227006:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914def lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084809 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227077:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0914df6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227093:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0914df6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227106:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0914df6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227121:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914dfd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227128:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914dfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227134:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914dfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227238:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41533600/0xc6b8ac1b0914e04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227247:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41533600/0xc6b8ac1b0914e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227253:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41533600/0xc6b8ac1b0914e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843172.227283:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788843172.227300:0:7168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788843172.227321:0:7168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41533600/0xc6b8ac1b0914e04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227333:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0914df6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227338:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0914df6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227382:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0914df6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227388:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843172.227392:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0914df6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227400:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0914df6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227412:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab61f39900) 00010000:00010000:3.0:1788843172.227422:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843172.227428:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0914df6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227434:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0914df6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227453:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914dfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227459:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914dfd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227465:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914dfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227471:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843172.227474:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914dfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227480:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914dfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227487:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8dab43e63800) 00010000:00010000:3.0:1788843172.227489:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843172.227491:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914dfd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227497:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914dfd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227531:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914def lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084809 expref: 10 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227558:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41533600/0xc6b8ac1b0914e04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084809 expref: 9 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.227564:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dab43e63d00) 00010000:00010000:3.0:1788843172.227566:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843172.227568:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41533600, rc 0) 00000100:00100000:3.0:1788843172.227638:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+9:9686:x1875737775719296:12345-192.168.203.29@tcp:101:chown.0 Request processed in 691us (4173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843172.227645:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:2.0:1788843172.232322:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843172.232503:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775719552 00000100:00100000:1.0:1788843172.232513:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775719552 00000100:00100000:1.0:1788843172.232583:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:1.0:1788843172.232594:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+9:9686:x1875737775719552:12345-192.168.203.29@tcp:36:chown.0 00010000:00010000:1.0:1788843172.232648:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843172.232676:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41533600/0xc6b8ac1b0914e04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084809 expref: 9 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.232698:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dab43e63d00) 00010000:00010000:1.0:1788843172.232712:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843172.234404:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914e0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.234430:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914e0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.234443:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914e0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788843172.303376:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:2.0:1788843172.303401:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:1.0:1788843172.303535:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001e60ec9f reply state 00000000ed672068 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914e0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843172.303549:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788843172.303568:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:1.0:1788843172.303696:0:5848:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788843172.303737:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:9686:x1875737775719552:12345-192.168.203.29@tcp:36:chown.0 Request processed in 71141us (71423us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788843172.303745:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00010000:00010000:3.0:1788843172.303836:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914e0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.303846:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914e0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.303854:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914e0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.303859:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933be00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843172.303864:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914e0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.303871:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914e0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.303889:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dab61f39100) 00010000:00010000:3.0:1788843172.303892:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788843172.303897:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914e0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.303925:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914e0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843172.326909:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843172.327004:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775719680 00000100:00100000:0.0:1788843172.327014:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775719680 00000100:00100000:0.0:1788843172.327083:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:0.0:1788843172.327094:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+6:9687:x1875737775719680:12345-192.168.203.29@tcp:101:touch.500 00010000:00010000:0.0:1788843172.327129:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843172.327152:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0914e12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084810 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788843172.331209:0:5846:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3996us 00010000:00010000:2.0:1788843172.351071:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914e19 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.351101:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914e19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.351114:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914e19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.351140:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0914e20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.351148:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0914e20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.351156:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0914e20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.351552:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0914e27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.351562:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0914e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.351570:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0914e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843172.351593:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788843172.351598:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843172.351639:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0914e27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.351652:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914e19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.351658:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914e19 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.351666:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914e19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.351682:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843172.351688:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914e19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.351695:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914e19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.351710:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab61f39900) 00010000:00010000:2.0:1788843172.351714:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843172.351718:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914e19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.351726:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914e19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.352313:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0914e20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.352322:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0914e20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.352329:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0914e20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.352334:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff89800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843172.352338:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0914e20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.352369:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0914e20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.352390:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8dab54910300) 00010000:00010000:2.0:1788843172.352393:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843172.352397:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0914e20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.352403:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0914e20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.352449:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0914e12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084810 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.352467:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0914e27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084810 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.352476:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dab54910100) 00010000:00010000:2.0:1788843172.352479:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788843172.352481:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88e00, rc 0) 00000100:00100000:2.0:1788843172.352613:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:9687:x1875737775719680:12345-192.168.203.29@tcp:101:touch.500 Request processed in 25519us (25715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843172.352623:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:1.0:1788843172.364075:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843172.364178:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775719936 00000100:00100000:3.0:1788843172.364189:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775719936 00000100:00100000:1.0:1788843172.365115:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:1.0:1788843172.365138:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:9687:x1875737775719936:12345-192.168.203.29@tcp:101:touch.500 00010000:00010000:1.0:1788843172.365165:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843172.365194:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0914e2e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084817 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.365558:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0914e35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.365573:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0914e35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.365585:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0914e35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.365658:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914e3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.365666:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914e3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.365672:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914e3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788843172.369186:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788843172.372294:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0914e43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.372337:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0914e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.372371:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0914e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.372418:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0914e35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.372425:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0914e35 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.372433:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0914e35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.372440:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b600 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843172.372445:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0914e35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.372453:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0914e35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.372468:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dab54910100) 00010000:00010000:1.0:1788843172.372471:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843172.372477:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0914e35 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.372483:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0914e35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843172.372503:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078d62b4b reply state 00000000c8d237f6 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914e3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843172.372522:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788843172.372567:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0914e2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084817 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.372584:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0914e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084817 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.372592:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dab61f39000) 00010000:00010000:1.0:1788843172.372595:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843172.372598:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933ac00, rc 0) 00000100:00100000:1.0:1788843172.372679:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+10:9687:x1875737775719936:12345-192.168.203.29@tcp:101:touch.500 Request processed in 7546us (8620us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788843172.372689:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00010000:00010000:3.0:1788843172.385305:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914e3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.385324:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914e3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.385331:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914e3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.385337:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843172.385372:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914e3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.385381:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914e3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.385398:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x27b6432d (ffff8dab61f39300) 00010000:00010000:3.0:1788843172.385401:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843172.385407:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914e3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.385413:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914e3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843172.393821:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843172.394029:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775720192 00000100:00100000:3.0:1788843172.394043:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775720192 00000100:00100000:3.0:1788843172.394123:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:3.0:1788843172.394137:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+9:9687:x1875737775720192:12345-192.168.203.29@tcp:36:touch.500 00010000:00010000:3.0:1788843172.394265:0:7168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843172.394305:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0914e43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084817 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.394325:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dab61f39000) 00010000:00010000:3.0:1788843172.394372:0:7168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843172.394417:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914e51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.394430:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914e51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.394440:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914e51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843172.394579:0:7168:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd0819a3 reply state 00000000fb49318b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914e51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843172.394589:0:7168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788843172.394680:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+10:9687:x1875737775720192:12345-192.168.203.29@tcp:36:touch.500 Request processed in 547us (870us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788843172.394687:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00010000:00010000:2.0:1788843172.398643:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914e51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.398662:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914e51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.398670:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914e51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.398695:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41532e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843172.398701:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914e51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.398709:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914e51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.398727:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dab43e63600) 00010000:00010000:2.0:1788843172.398730:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843172.398744:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914e51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.398752:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914e51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843172.403085:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843172.403173:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775720320 00000100:00100000:2.0:1788843172.403185:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775720320 00000100:00100000:2.0:1788843172.403259:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:2.0:1788843172.403273:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+9:9687:x1875737775720320:12345-192.168.203.29@tcp:101:touch.500 00010000:00010000:2.0:1788843172.403309:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843172.403335:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0914e58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c60708481e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.403445:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0914e58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708481e expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.403461:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0914e58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708481e expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.403509:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dab54910300) 00010000:00010000:2.0:1788843172.403513:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788843172.403518:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89800, rc 0) 00000100:00100000:2.0:1788843172.404910:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51454380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+10:9687:x1875737775720320:12345-192.168.203.29@tcp:101:touch.500 Request processed in 1625us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843172.404922:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:1.0:1788843172.413132:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843172.413538:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775720448 00000100:00100000:2.0:1788843172.413549:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775720448 00000100:00100000:2.0:1788843172.413608:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:2.0:1788843172.413619:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1875737775720448:12345-192.168.203.29@tcp:8:touch.500 00010000:00080000:2.0:1788843172.413660:0:6694:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp t0 exp 0000000000000000 cur 296 last 0 00000020:00000080:2.0:1788843172.413692:0:6694:0:(genops.c:1385:class_connect()) connect: client fb38c5ab-0241-4970-81c2-7e93fb808128, cookie 0xc6b8ac1b0914e5f 00002000:00100000:2.0:1788843172.413705:0:6694:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fb38c5ab-0241-4970-81c2-7e93fb808128/ffff8dab77a7d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788843172.413747:0:6694:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788843172.414036:0:6694:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788843172.414077:0:6694:0:(import.c:65:import_set_state_nolock()) ffff8dab77a7e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843172.414165:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2355:x1875737775720448:12345-192.168.203.29@tcp:8:touch.500 Request processed in 545us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843172.414174:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:0.0:1788843172.420375:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843172.420619:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775720576 00000100:00100000:2.0:1788843172.420630:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775720576 00000100:00100000:2.0:1788843172.420767:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:2.0:1788843172.420779:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:0:x1875737775720576:12345-192.168.203.29@tcp:2:touch.500 00000100:00080000:0.0:1788843172.433294:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788843172.494732:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1788843172.495018:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fb38c5ab-0241-4970-81c2-7e93fb808128 00000100:00100000:3.0:1788843172.501175:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+5:0:x1875737775720576:12345-192.168.203.29@tcp:2:touch.500 Request processed in 80386us (80823us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788843172.501191:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:2.0:1788843172.506238:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843172.506319:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775720832 00000100:00100000:0.0:1788843172.506328:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775720832 00000100:00100000:0.0:1788843172.506438:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:0.0:1788843172.506448:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+10:9687:x1875737775720832:12345-192.168.203.29@tcp:35:touch.500 00000100:00100000:0.0:1788843172.506809:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+11:9687:x1875737775720832:12345-192.168.203.29@tcp:35:touch.500 Request processed in 361us (581us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788843172.506817:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:1.0:1788843172.547827:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843172.547924:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775720960 00000100:00100000:3.0:1788843172.547935:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775720960 00000100:00100000:3.0:1788843172.548044:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:3.0:1788843172.548056:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+11:9688:x1875737775720960:12345-192.168.203.29@tcp:101:rm.0 00010000:00010000:3.0:1788843172.548086:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843172.548112:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532400/0xc6b8ac1b0914e66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084825 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.548224:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0914e6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.548240:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0914e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.548252:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0914e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843172.548306:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788843172.548311:0:7168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788843172.548396:0:7168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0914e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.548442:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532400/0xc6b8ac1b0914e66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084825 expref: 13 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.548467:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0914e6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084825 expref: 12 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.548477:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dab54910100) 00010000:00010000:3.0:1788843172.548480:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843172.548483:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41532a00, rc 0) 00000100:00100000:3.0:1788843172.548553:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51456a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+12:9688:x1875737775720960:12345-192.168.203.29@tcp:101:rm.0 Request processed in 499us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843172.548568:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:1.0:1788843172.563601:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843172.564794:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775721216 00000100:00100000:0.0:1788843172.564809:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775721216 00000100:00100000:0.0:1788843172.564875:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:0.0:1788843172.564886:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+12:9688:x1875737775721216:12345-192.168.203.29@tcp:101:rm.0 00010000:00010000:0.0:1788843172.564907:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843172.564928:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914e74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c60708482c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843172.565026:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788843172.565224:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914e74 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708482c expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.565238:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab61f39900) 00010000:00010000:0.0:1788843172.565242:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788843172.565247:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914e74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708482c expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.565263:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4400, rc 0) 00000100:00100000:0.0:1788843172.565538:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51455880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+13:9688:x1875737775721216:12345-192.168.203.29@tcp:101:rm.0 Request processed in 455us (1746us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788843172.565549:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:1.0:1788843172.569963:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843172.570034:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775721344 00000100:00100000:0.0:1788843172.570057:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775721344 00000100:00100000:0.0:1788843172.570106:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:0.0:1788843172.570115:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+13:9688:x1875737775721344:12345-192.168.203.29@tcp:37:rm.0 00000100:00100000:2.0:1788843172.576332:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51454a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+13:9688:x1875737775721344:12345-192.168.203.29@tcp:37:rm.0 Request processed in 6206us (6377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843172.576383:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:1.0:1788843172.580754:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843172.580882:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775721600 00000100:00100000:3.0:1788843172.580893:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775721600 00000100:00100000:3.0:1788843172.580952:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:3.0:1788843172.580963:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6640f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+13:9688:x1875737775721600:12345-192.168.203.29@tcp:35:rm.0 00000100:00100000:3.0:1788843172.581199:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6640f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+14:9688:x1875737775721600:12345-192.168.203.29@tcp:35:rm.0 Request processed in 230us (446us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788843172.581208:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:1.0:1788843172.584558:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843172.584833:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775721856 00000100:00100000:3.0:1788843172.584845:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775721856 00000100:00100000:3.0:1788843172.585027:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:3.0:1788843172.585041:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+14:9688:x1875737775721856:12345-192.168.203.29@tcp:101:rm.0 00010000:00010000:3.0:1788843172.585073:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843172.585100:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532400/0xc6b8ac1b0914e82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084833 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.585239:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914e89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.585255:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914e89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.585267:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914e89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843172.585278:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788843172.585915:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532400/0xc6b8ac1b0914e82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084833 expref: 17 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.585953:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914e89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084833 expref: 16 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.585962:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dab54910100) 00010000:00010000:3.0:1788843172.585965:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788843172.585968:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41532e00, rc 0) 00000100:00100000:3.0:1788843172.586044:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51454000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+16:9688:x1875737775721856:12345-192.168.203.29@tcp:101:rm.0 Request processed in 1005us (1497us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788843172.586051:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:1.0:1788843172.588999:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843172.589100:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775721984 00000100:00100000:0.0:1788843172.589111:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775721984 00000100:00100000:0.0:1788843172.589200:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:0.0:1788843172.589212:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+16:9688:x1875737775721984:12345-192.168.203.29@tcp:41:rm.0 00000004:00000024:0.0:1788843172.589274:0:5847:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1788843172.589384:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51456300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+16:9688:x1875737775721984:12345-192.168.203.29@tcp:41:rm.0 Request processed in 173us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843172.589392:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:1.0:1788843172.592912:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843172.593053:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775722112 00000100:00100000:2.0:1788843172.593064:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775722112 00000100:00100000:2.0:1788843172.593139:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:2.0:1788843172.593159:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+16:9688:x1875737775722112:12345-192.168.203.29@tcp:101:rm.0 00010000:00010000:2.0:1788843172.593199:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843172.593225:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0914e97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c60708483a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593311:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914e9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593329:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914e9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593385:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914e9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593402:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ea5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593409:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593417:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593553:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89c00/0xc6b8ac1b0914eac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593562:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89c00/0xc6b8ac1b0914eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593570:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89c00/0xc6b8ac1b0914eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843172.593595:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788843172.593599:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843172.593615:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89c00/0xc6b8ac1b0914eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593626:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89c00/0xc6b8ac1b0914eac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593634:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914e9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593641:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914e9e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593648:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914e9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593653:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843172.593657:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914e9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593665:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914e9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593685:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dab54910100) 00010000:00010000:2.0:1788843172.593687:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843172.593692:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914e9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593697:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914e9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593711:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593717:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ea5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593722:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593727:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843172.593729:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593735:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ea5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593741:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x27b6432d (ffff8dab54910400) 00010000:00010000:2.0:1788843172.593743:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843172.593746:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ea5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593751:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ea5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593797:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0914e97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708483a expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593826:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89c00/0xc6b8ac1b0914eac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708483a expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.593834:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dab54910300) 00010000:00010000:2.0:1788843172.593836:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843172.593838:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89c00, rc 0) 00000100:00100000:2.0:1788843172.593914:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51457100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+17:9688:x1875737775722112:12345-192.168.203.29@tcp:101:rm.0 Request processed in 757us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843172.593921:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:1.0:1788843172.598649:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843172.598969:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775722368 00000100:00100000:0.0:1788843172.598979:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775722368 00000100:00100000:0.0:1788843172.599067:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:0.0:1788843172.599077:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+17:9688:x1875737775722368:12345-192.168.203.29@tcp:36:rm.0 00010000:00010000:0.0:1788843172.599125:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788843172.599158:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89c00/0xc6b8ac1b0914eac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708483a expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.599183:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0914e58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708481e expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.599199:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dab54910300) 00010000:00010000:0.0:1788843172.599214:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0914e6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084825 expref: 15 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.599223:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dab54910100) 00010000:00010000:0.0:1788843172.599239:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843172.599260:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914eb3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.599273:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914eb3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.599282:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914eb3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.599305:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0914eba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.599312:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0914eba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.599318:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0914eba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.599614:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0914ec1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.599623:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0914ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.599630:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0914ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843172.601005:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788843172.601020:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 296851677813ns, next at 297851674570ns, rc = 0 00010000:00010000:0.0:1788843172.601087:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914ec8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601110:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601119:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914ec8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601127:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914ec8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601134:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914ec8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601298:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914ec8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601391:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843172.601413:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0914ec1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601420:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0914ec1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601434:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0914ec1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601440:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843172.601445:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0914ec1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601453:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0914ec1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601474:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dab43eced00) 00010000:00010000:0.0:1788843172.601476:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788843172.601481:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0914ec1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601487:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0914ec1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601504:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914eb3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601509:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914eb3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601514:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914eb3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601518:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843172.601521:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914eb3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601526:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914eb3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601531:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dab54910100) 00010000:00010000:0.0:1788843172.601533:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843172.601536:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914eb3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843172.601541:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914eb3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788843172.601557:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e040165 reply state 000000005ca2bd4c transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0914eba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843172.601565:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788843172.601653:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51457b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+16:9688:x1875737775722368:12345-192.168.203.29@tcp:36:rm.0 Request processed in 2574us (3009us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788843172.601661:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 30 00010000:00010000:1.0:1788843172.602652:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843172.602662:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914ec8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.602681:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843172.602684:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914ec8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.602691:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914ec8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.602768:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dab43eced00) 00010000:00010000:1.0:1788843172.602771:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788843172.602776:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914ec8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.602781:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914ec8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843172.602803:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843172.602879:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843172.602883:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843172.603587:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0914eba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.603598:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0914eba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.603604:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0914eba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.603609:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843172.603613:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0914eba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.603620:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0914eba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.603632:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x27b6432d (ffff8dab43ece200) 00010000:00010000:3.0:1788843172.603634:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843172.603638:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0914eba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843172.603652:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0914eba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x27b6432d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843172.606828:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843172.607085:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775722624 00000100:00100000:3.0:1788843172.607096:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775722624 00000100:00100000:3.0:1788843172.607192:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:3.0:1788843172.607203:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+15:9688:x1875737775722624:12345-192.168.203.29@tcp:35:rm.0 00000100:00100000:3.0:1788843172.607484:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51455c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+16:9688:x1875737775722624:12345-192.168.203.29@tcp:35:rm.0 Request processed in 283us (664us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788843172.607492:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:1.0:1788843172.611163:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843172.611325:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775722880 00000100:00100000:2.0:1788843172.611336:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775722880 00000100:00100000:2.0:1788843172.611446:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:2.0:1788843172.611457:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+16:9688:x1875737775722880:12345-192.168.203.29@tcp:36:rm.0 00010000:00010000:2.0:1788843172.611517:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788843172.611545:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914e89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084833 expref: 16 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.611564:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0914e27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084810 expref: 15 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.611575:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dab54910100) 00010000:00010000:2.0:1788843172.611588:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0914de8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084802 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.611617:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab61f39900) 00010000:00010000:2.0:1788843172.611626:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843172.611652:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0914ecf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.611665:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0914ecf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.611674:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0914ecf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.611686:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ed6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.611692:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.611818:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.612180:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914edd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.612190:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914edd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.612197:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914edd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843172.612799:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788843172.612816:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914edd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.612830:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914edd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.612837:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914edd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.612843:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843172.612848:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914edd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.612855:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914edd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.612867:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dab54910c00) 00010000:00010000:2.0:1788843172.612870:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788843172.612874:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914edd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.612880:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0914edd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.612899:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0914ecf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.612905:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0914ecf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.612910:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0914ecf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.612915:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843172.612923:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0914ecf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.612929:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0914ecf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.612936:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910400) 00010000:00010000:2.0:1788843172.612938:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843172.612941:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0914ecf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.612945:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0914ecf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843172.613487:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfd4ece2 reply state 00000000877354d5 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843172.613496:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788843172.613578:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51456680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+15:9688:x1875737775722880:12345-192.168.203.29@tcp:36:rm.0 Request processed in 2120us (2420us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788843172.613586:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 31 00010000:00010000:2.0:1788843172.616217:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843172.623901:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ed6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.623922:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ed6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.623930:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ed6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.623936:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843172.623957:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ed6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.623966:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ed6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.623983:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8dab54910200) 00010000:00010000:2.0:1788843172.623986:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843172.623991:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ed6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843172.623997:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0914ed6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843173.639132:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843174.032566:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843174.032638:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775723008 00000100:00100000:3.0:1788843174.032649:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775723008 00000100:00100000:3.0:1788843174.032766:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 244 00000100:00100000:3.0:1788843174.032778:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2359:x1875737775723008:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843174.032932:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48999050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2359:x1875737775723008:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 155us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843174.032940:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 244 00000100:00100000:0.0:1788843174.039317:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843174.039413:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775723136 00000100:00100000:2.0:1788843174.039426:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775723136 00000100:00080000:0.0:1788843174.039489:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843174.039533:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 95 00000100:00100000:2.0:1788843174.039546:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+14:2359:x1875737775723136:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843174.039648:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+14:2359:x1875737775723136:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 104us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843174.039657:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 95 00000100:00100000:0.0:1788843174.053517:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843174.053676:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843174.053905:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775723392 00000100:00100000:3.0:1788843174.053987:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775723392 00000100:00100000:1.0:1788843174.054054:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775723264 00000100:00100000:1.0:1788843174.054060:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775723264 00000100:00100000:3.0:1788843174.054123:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 96 00000100:00100000:3.0:1788843174.054142:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2358:x1875737775723392:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843174.054218:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2358:x1875737775723392:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 78us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843174.054225:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 96 00000100:00080000:0.0:1788843174.055060:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843174.055075:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843174.055079:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:1.0:1788843174.055092:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2358:x1875737775723264:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843174.055154:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2358:x1875737775723264:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 65us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843174.055161:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:1.0:1788843174.222187:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788843174.222217:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795677696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843174.222306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843174.222400:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795677696 00000100:00100000:1.0:1788843174.222411:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795677696 00000100:00100000:1.0:1788843174.222478:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788843174.222489:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795677696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843174.222536:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843174.222594:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795677696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843174.222603:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788843174.222630:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788843174.222660:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab51454a80 x1875737795677696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843190 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843174.222682:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795677696:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1788843174.222883:0:6965:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 298473540510ns, next at 299473537646ns, rc = 0 00010000:00010000:3.0:1788843174.661371:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843175.236890:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795677952:0@lo:400:kworker.0 00000100:00100000:2.0:1788843175.236967:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843175.237051:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795678464:0@lo:400:kworker.0 00000100:00100000:2.0:1788843175.237078:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843175.237109:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843175.237116:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795678080:0@lo:400:kworker.0 00000100:00100000:2.0:1788843175.237154:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843175.237183:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795677952 00000100:00100000:2.0:1788843175.237190:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795677952 00000100:00100000:2.0:1788843175.237231:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795678080 00000100:00100000:2.0:1788843175.237234:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795678080 00000100:00100000:2.0:1788843175.237259:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788843175.237279:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795677952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843175.237334:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795677952:12345-0@lo:400:kworker.0 Request processed in 68us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843175.237375:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788843175.237392:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788843175.237398:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795678080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843175.237421:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795678080:12345-0@lo:400:kworker.0 Request processed in 25us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843175.237426:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788843175.237645:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795678080:0@lo:400:kworker.0 00000100:00100000:2.0:1788843175.237660:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795677952:0@lo:400:kworker.0 00000100:00100000:1.0:1788843175.237739:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795677824:0@lo:400:kworker.0 00000100:00100000:1.0:1788843175.237772:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843175.237803:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795678336:0@lo:400:kworker.0 00000100:00100000:1.0:1788843175.237823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843175.237841:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788843175.237846:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795678208:0@lo:400:kworker.0 00000100:00100000:1.0:1788843175.237868:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843175.237896:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795678464 00000100:00100000:1.0:1788843175.237900:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795678464 00000100:00100000:1.0:1788843175.237927:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795678208 00000100:00100000:1.0:1788843175.237930:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795678208 00000100:00100000:1.0:1788843175.237958:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788843175.237964:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795678464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843175.238002:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795678464:12345-0@lo:400:kworker.0 Request processed in 39us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843175.238009:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788843175.238022:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788843175.238028:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795678208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843175.238053:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795678208:12345-0@lo:400:kworker.0 Request processed in 26us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843175.238058:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1788843175.238070:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788843175.238074:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788843175.238098:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7cd41180 x1875737795678208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843175.238108:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795678208:0@lo:400:kworker.0 00000100:00100000:1.0:1788843175.238122:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795678336 00000100:00100000:1.0:1788843175.238125:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795678336 00000100:00100000:1.0:1788843175.238145:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788843175.238150:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795678336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843175.238176:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795678336:12345-0@lo:400:kworker.0 Request processed in 26us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843175.238181:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:1.0:1788843175.238190:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843175.238202:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795678336:0@lo:400:kworker.0 00010000:00080000:1.0:1788843175.238222:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7cd42300 x1875737795678464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843175.238241:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795678464:0@lo:400:kworker.0 00000100:00100000:2.0:1788843175.238486:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795677824 00000100:00100000:2.0:1788843175.238491:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795677824 00000100:00100000:2.0:1788843175.238696:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788843175.238703:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3305:x1875737795677824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843175.238753:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51534450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3305:x1875737795677824:12345-0@lo:400:kworker.0 Request processed in 50us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843175.238760:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788843175.238864:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795677824:0@lo:400:kworker.0 00010000:00010000:1.0:1788843175.685553:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843175.748648:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843175.748671:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795678592:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843175.748742:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843175.748826:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795678592 00000100:00100000:0.0:1788843175.748835:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795678592 00000100:00100000:0.0:1788843175.748887:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788843175.748896:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795678592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843175.748929:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843175.748992:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795678592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843175.748999:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1788843175.749042:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e8e3b80 x1875737795678592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843191 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843175.749061:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e8e3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795678592:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788843176.655979:0:11620:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1788843176.710992:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788843177.342283:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:2.0:1788843177.342295:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000004:00080000:2.0:1788843177.342334:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788843177.342368:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1788843177.342580:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7766e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795678720:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788843177.343781:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843177.344512:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795678720 00000100:00100000:1.0:1788843177.344522:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795678720 00000100:00100000:1.0:1788843177.344710:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788843177.344723:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795678720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788843177.344754:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1788843177.344792:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f94a4, atime: 0x6a9f94a4, ctime: 0x6a9f94a4, blocks: 0x1 00010000:00010000:1.0:1788843177.344801:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f18066e/0xc6b8ac1b0914ee4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843177.344828:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=301s v=(0 0) 00010000:00010000:1.0:1788843177.344833:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843177.344840:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f18066e/0xc6b8ac1b0914ee4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843177.344858:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f18066e/0xc6b8ac1b0914ee4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843177.344868:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006f18066e/0xc6b8ac1b0914ee4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843177.344883:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006f18066e/0xc6b8ac1b0914ee4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843177.344909:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788843177.345556:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875737795678720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 833us (1776us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788843177.345565:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788843177.345651:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843177.345661:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006f18066e/0xc6b8ac1b0914ee4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.345672:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933be00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843177.345677:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006f18066e/0xc6b8ac1b0914ee4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.345686:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006f18066e/0xc6b8ac1b0914ee4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.345706:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006f18066e/0xc6b8ac1b0914ee4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.345714:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f18066e/0xc6b8ac1b0914ee4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.345736:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843177.345738:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843177.345740:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788843177.346001:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788843177.347475:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dab7766e680/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788843177.347488:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7766e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795678720:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788843177.738554:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788843177.782854:0:11670:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeca2cda30 20000000:00000080:3.0:1788843177.782871:0:11670:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dab6ec27c00 uarg=0000000000000000 20000000:01000000:3.0:1788843177.782906:0:11670:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788843177.782913:0:11670:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788843177.782917:0:11670:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788843177.783914:0:11671:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788843177.784093:0:11670:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788843177.791314:0:11670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788843177.791537:0:11670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788843177.791605:0:11670:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788843177.791625:0:11670:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788843177.791646:0:11670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914eeb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843177.791742:0:11670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab82055e00/0xc6b8ac1b0914d8d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d86 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843177.791751:0:11670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0914d9b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914d94 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843177.791758:0:11670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914da9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914da2 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843177.791768:0:11670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab4933b000/0xc6b8ac1b0914db0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070847ed expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843177.791776:0:11670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab82054200/0xc6b8ac1b0914db7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070847f4 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843177.791783:0:11670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914eeb lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843177.791830:0:11670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab82054200/0xc6b8ac1b0914db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070847f4 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843177.791846:0:11670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab82054200/0xc6b8ac1b0914db7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070847f4 expref: 12 pid: 5839 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843177.791879:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11670:1875737795678848:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843177.792048:0:11670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab4933b000/0xc6b8ac1b0914db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070847ed expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843177.792057:0:11670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab4933b000/0xc6b8ac1b0914db0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070847ed expref: 12 pid: 5841 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843177.792066:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11670:1875737795678976:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843177.792100:0:11670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914da9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914da2 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843177.792109:0:11670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914da9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914da2 expref: 18 pid: 5839 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843177.792117:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11670:1875737795679104:0@lo:104: 00000100:00100000:2.0:1788843177.792156:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788843177.792213:0:11670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0914d9b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914d94 expref: 18 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843177.792221:0:11670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0914d9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d94 expref: 18 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843177.792229:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11670:1875737795679232:0@lo:104: 00000100:00100000:2.0:1788843177.792261:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788843177.792298:0:11670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab82055e00/0xc6b8ac1b0914d8d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0914d86 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843177.792306:0:11670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dab82055e00/0xc6b8ac1b0914d8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d86 expref: 18 pid: 5839 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843177.792321:0:11670:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11670:1875737795679360:0@lo:104: 00000100:00100000:2.0:1788843177.792373:0:11670:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843177.792389:0:11670:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7770e180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843177.792480:0:6717:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788843177.792498:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795679104 00000100:00100000:3.0:1788843177.792504:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795679104 00000100:00100000:3.0:1788843177.792540:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795679232 00000100:00100000:3.0:1788843177.792543:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795679232 00000100:00100000:3.0:1788843177.792552:0:6717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795679360 00000100:00100000:3.0:1788843177.792554:0:6717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795679360 00000100:00100000:3.0:1788843177.792566:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788843177.792575:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28cf63da-daee-485f-b466-4ec68876f732+5:11670:x1875737795679104:12345-0@lo:104: 00010000:00010000:3.0:1788843177.792588:0:6717:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914da2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914da9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.792653:0:6717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788843177.792667:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28cf63da-daee-485f-b466-4ec68876f732+5:11670:x1875737795679104:12345-0@lo:104: Request processed in 86us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843177.792674:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788843177.792693:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788843177.792699:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28cf63da-daee-485f-b466-4ec68876f732+4:11670:x1875737795679232:12345-0@lo:104: 00010000:00010000:3.0:1788843177.792707:0:6717:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914d9b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.792741:0:6717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788843177.792746:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28cf63da-daee-485f-b466-4ec68876f732+4:11670:x1875737795679232:12345-0@lo:104: Request processed in 48us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843177.792751:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788843177.792763:0:6717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788843177.792769:0:6717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28cf63da-daee-485f-b466-4ec68876f732+3:11670:x1875737795679360:12345-0@lo:104: 00010000:00010000:3.0:1788843177.792777:0:6717:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0914d86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914d8d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.792823:0:6717:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788843177.792828:0:6717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:28cf63da-daee-485f-b466-4ec68876f732+3:11670:x1875737795679360:12345-0@lo:104: Request processed in 59us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843177.792835:0:6717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788843177.792875:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788843177.792881:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914da2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914da9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.792888:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4200 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843177.792892:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914da2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914da9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.792900:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914da9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843177.792907:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914da2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914da9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843177.792911:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788843177.792940:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914da2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914da9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.792947:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843177.792966:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914da2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914da9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.792973:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914da2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914da9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.792997:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843177.793000:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914d9b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.793006:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88400 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843177.793008:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d94 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914d9b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.793015:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914d9b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843177.793020:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d94 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914d9b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843177.793024:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788843177.793037:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d94 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914d9b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.793043:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843177.793058:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d94 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914d9b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.793064:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914d94 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914d9b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.793072:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843177.793075:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0914d86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0914d8d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.793091:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b800 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843177.793093:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0914d86 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0914d8d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.793100:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0914d86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0914d8d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843177.793105:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0914d86 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0914d8d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843177.793110:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788843177.793123:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0914d86 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914d8d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.793129:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843177.793135:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0914d86 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914d8d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.793141:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0914d86 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0914d8d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.793155:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843177.793156:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843177.793159:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843177.793165:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843177.793170:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843177.793186:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795679488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843177.793217:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843177.793271:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795679616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843177.793297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843177.793316:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843177.793321:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795679744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843177.793374:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843177.793403:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795679488 00000100:00100000:3.0:1788843177.793408:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795679488 00010000:00010000:3.0:1788843177.793426:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914da9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914da2 expref: 19 pid: 5839 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843177.793445:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795679616 00000100:00100000:3.0:1788843177.793448:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795679616 00010000:00010000:3.0:1788843177.793459:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0914d9b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d94 expref: 20 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843177.793473:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795679744 00000100:00100000:3.0:1788843177.793476:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795679744 00010000:00010000:3.0:1788843177.793488:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab82055e00/0xc6b8ac1b0914d8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d86 expref: 21 pid: 5839 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843177.793502:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788843177.793508:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+21:3305:x1875737795679488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843177.793518:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843177.793523:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914da9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914da2 expref: 21 pid: 5839 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.793532:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914da9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914da2 expref: 21 pid: 5839 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.793549:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843177.793578:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+21:3305:x1875737795679488:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843177.793590:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788843177.793604:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788843177.793610:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+20:3306:x1875737795679616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843177.793618:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843177.793623:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0914d9b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d94 expref: 20 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.793631:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0914d9b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d94 expref: 20 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.793647:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843177.793676:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+20:3306:x1875737795679616:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843177.793683:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788843177.793699:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788843177.793706:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51550c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795679744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843177.793715:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843177.793720:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab82055e00/0xc6b8ac1b0914d8d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d86 expref: 19 pid: 5839 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.793728:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab82055e00/0xc6b8ac1b0914d8d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0914d86 expref: 19 pid: 5839 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843177.793738:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843177.793763:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51550c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795679744:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843177.793769:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788843177.793834:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795679488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843177.793866:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795679744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843177.793873:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795679616:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843177.796048:0:11670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab82054a00/0xc6b8ac1b0914da9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914da2 expref: 18 pid: 5839 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843177.796068:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11670:1875737795679104:0@lo:104: 00010000:00010000:2.0:1788843177.796081:0:11670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0914d9b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914d94 expref: 17 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843177.796090:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11670:1875737795679232:0@lo:104: 00010000:00010000:2.0:1788843177.796100:0:11670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab82055e00/0xc6b8ac1b0914d8d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0914d86 expref: 16 pid: 5839 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843177.796109:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11670:1875737795679360:0@lo:104: 00000100:00100000:1.0:1788843177.798575:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11670:1875737795678848:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843177.798594:0:11670:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11670:1875737795678976:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843177.798631:0:11670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914eeb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843177.799192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843177.799537:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775723520 00000100:00100000:1.0:1788843177.799545:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775723520 00010000:00010000:1.0:1788843177.799583:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab82054200/0xc6b8ac1b0914db7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070847f4 expref: 13 pid: 5839 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843177.799620:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:1.0:1788843177.799629:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2358:x1875737775723520:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843177.799643:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843177.799649:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab82054200/0xc6b8ac1b0914db7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070847f4 expref: 13 pid: 5839 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843177.799661:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab82054200/0xc6b8ac1b0914db7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070847f4 expref: 13 pid: 5839 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843177.799695:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab82054200/0xc6b8ac1b0914db7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070847f4 expref: 13 pid: 5839 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843177.799715:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843177.799763:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:2358:x1875737775723520:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 134us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843177.799771:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:1.0:1788843177.806053:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843177.809886:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775723648 00000100:00100000:0.0:1788843177.809903:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775723648 00010000:00010000:0.0:1788843177.809956:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab4933b000/0xc6b8ac1b0914db0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070847ed expref: 12 pid: 5841 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843177.810004:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:0.0:1788843177.810016:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:2358:x1875737775723648:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843177.810032:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843177.810039:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab4933b000/0xc6b8ac1b0914db0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070847ed expref: 12 pid: 5841 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843177.810054:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab4933b000/0xc6b8ac1b0914db0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070847ed expref: 12 pid: 5841 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843177.810072:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab4933b000/0xc6b8ac1b0914db0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070847ed expref: 12 pid: 5841 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843177.810092:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914eeb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843177.810101:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914eeb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843177.810138:0:7638:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914eeb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843177.810145:0:7638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914eeb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843177.810152:0:7638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914eeb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843177.810159:0:7638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914eeb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843177.810165:0:7638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff89c00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843177.810170:0:7638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914eeb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843177.810178:0:7638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914eeb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843177.810202:0:7638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914eeb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843177.810214:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843177.810232:0:11670:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914eeb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843177.810245:0:11670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914eeb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843177.810263:0:11670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914eeb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843177.810290:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+11:2358:x1875737775723648:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 275us (4247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843177.810299:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 34 00000001:00080000:3.0:1788843177.898774:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1788843178.756964:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843179.151899:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843179.151948:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843179.151980:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843179.152042:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843179.152085:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775723904 00000100:00100000:0.0:1788843179.152097:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775723904 00000100:00100000:0.0:1788843179.152173:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775724160 00000100:00100000:0.0:1788843179.152176:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775724160 00000100:00100000:0.0:1788843179.152204:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 100 00000100:00100000:0.0:1788843179.152216:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775723904:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843179.152331:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775723904:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 116us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843179.152390:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 100 00000100:00100000:0.0:1788843179.152419:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 101 00000100:00100000:1.0:1788843179.152430:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775724032 00000100:00100000:0.0:1788843179.152430:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775724160:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843179.152448:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775724032 00000100:00100000:0.0:1788843179.152467:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775724160:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 39us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843179.152478:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 101 00000100:00080000:0.0:1788843179.152502:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843179.152510:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843179.152541:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00100000:1.0:1788843179.152553:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775724032:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843179.152626:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775724032:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 75us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843179.152633:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00100000:3.0:1788843179.153088:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775723776 00000100:00100000:3.0:1788843179.153096:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775723776 00000100:00100000:3.0:1788843179.153146:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 246 00000100:00100000:3.0:1788843179.153155:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+11:2359:x1875737775723776:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843179.153206:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51535850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+11:2359:x1875737775723776:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 53us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843179.153213:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 246 00000100:00100000:0.0:1788843179.216458:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843179.216581:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775724288 00000100:00100000:2.0:1788843179.216597:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775724288 00000100:00100000:2.0:1788843179.216683:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 247 00000100:00100000:2.0:1788843179.216696:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+11:5598:x1875737775724288:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843179.216725:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843179.216760:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914ef2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084841 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843179.216802:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914ef2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084841 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843179.216816:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914ef2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084841 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843179.216859:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89c00, rc 0) 00000100:00100000:2.0:1788843179.216940:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51537850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:5598:x1875737775724288:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 246us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843179.216947:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 247 00000100:00100000:0.0:1788843179.225093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843179.225254:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775724416 00000100:00100000:2.0:1788843179.225269:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775724416 00000100:00100000:2.0:1788843179.225425:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 248 00000100:00100000:2.0:1788843179.225438:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:5598:x1875737775724416:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843179.226172:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51537050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:5598:x1875737775724416:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 730us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843179.226182:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 248 00000100:00100000:0.0:1788843179.229547:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843179.229769:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775724544 00000100:00100000:3.0:1788843179.229782:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775724544 00000100:00100000:3.0:1788843179.229961:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 249 00000100:00100000:3.0:1788843179.229973:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:5598:x1875737775724544:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843179.230383:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51537450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:5598:x1875737775724544:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 408us (847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843179.230393:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 249 00000100:00100000:0.0:1788843179.236120:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843179.236260:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775724672 00000100:00100000:2.0:1788843179.236274:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775724672 00000100:00100000:2.0:1788843179.236385:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 250 00000100:00100000:2.0:1788843179.236399:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:9959:x1875737775724672:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843179.236763:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51534c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:9959:x1875737775724672:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 365us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843179.236772:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 250 00000100:00100000:1.0:1788843179.253720:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843179.261310:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775724800 00000100:00100000:0.0:1788843179.261335:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775724800 00000100:00100000:0.0:1788843179.261642:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 251 00000100:00100000:1.0:1788843179.264266:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:9959:x1875737775724800:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788843179.265445:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51535450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:9959:x1875737775724800:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 3783us (11740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843179.265460:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 251 00000100:00100000:2.0:1788843179.280389:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843179.282644:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775724928 00000100:00100000:3.0:1788843179.282720:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775724928 00000100:00100000:3.0:1788843179.286296:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 252 00000100:00100000:3.0:1788843179.286331:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:5598:x1875737775724928:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843179.286372:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843179.287112:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab41532400/0xc6b8ac1b0914ef9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084848 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843179.287181:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41532400/0xc6b8ac1b0914ef9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084848 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843179.287196:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab41532400/0xc6b8ac1b0914ef9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084848 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843179.287208:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41532400, rc 0) 00000100:00100000:3.0:1788843179.287332:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51534850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:5598:x1875737775724928:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 1018us (6999us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843179.287370:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 252 00000100:00100000:0.0:1788843179.292417:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843179.293045:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775725056 00000100:00100000:1.0:1788843179.293060:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775725056 00000100:00100000:1.0:1788843179.293166:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 253 00000100:00100000:1.0:1788843179.293178:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:5598:x1875737775725056:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843179.293687:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51536450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:5598:x1875737775725056:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 508us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843179.293698:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 253 00000100:00100000:0.0:1788843179.297651:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843179.298989:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775725184 00000100:00100000:2.0:1788843179.299007:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775725184 00000100:00100000:2.0:1788843179.299082:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 254 00000100:00100000:2.0:1788843179.299094:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:5598:x1875737775725184:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843179.300156:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51535c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:5598:x1875737775725184:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 1053us (2509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843179.300182:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 254 00000100:00100000:3.0:1788843179.303040:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843179.303729:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775725312 00000100:00100000:1.0:1788843179.303745:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775725312 00000100:00100000:1.0:1788843179.303946:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 255 00000100:00100000:1.0:1788843179.303960:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:9962:x1875737775725312:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788843179.304313:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51536c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:9962:x1875737775725312:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 354us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843179.304322:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 255 00000100:00100000:0.0:1788843179.308548:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843179.309140:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775725440 00000100:00100000:3.0:1788843179.309155:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775725440 00000100:00100000:3.0:1788843179.309289:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 256 00000100:00100000:3.0:1788843179.309302:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:9962:x1875737775725440:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788843179.309905:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:9962:x1875737775725440:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 602us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843179.309916:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 256 00000100:00100000:0.0:1788843179.336110:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843179.336144:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e8e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795679872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843179.336265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843179.336891:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795679872 00000100:00100000:2.0:1788843179.336905:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795679872 00000100:00100000:2.0:1788843179.337006:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1788843179.337006:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843179.337018:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795679872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788843179.337072:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788843179.337169:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795679872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843179.337177:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788843179.337277:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1788843179.337284:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dab7766e680, transno 4294967300 00000100:00100000:0.0:1788843179.337412:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e8e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795679872:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788843179.780717:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788843179.781072:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788843179.781077:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab51a7d800 from 7 10000000:01000000:0.0:1788843179.781084:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843179.781146:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914f00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843179.781160:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914f00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843179.781174:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914f00 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843179.781206:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7766e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795680000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843179.781321:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843179.781440:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6e76b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843179.783248:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795680000 00000100:00100000:1.0:1788843179.783262:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795680000 00000100:00100000:1.0:1788843179.783374:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788843179.783386:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+16:5844:x1875737795680000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843179.783402:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843179.783422:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914f07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914f00 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843179.783470:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914f07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914f00 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843179.783482:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914f07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914f00 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843179.783491:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933ba00, rc 0) 00000100:00100000:1.0:1788843179.783579:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795680000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 196us (2258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843179.783586:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788843179.784317:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7766e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795680000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843179.784380:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914f00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914f07 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843179.784396:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914f00 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914f07 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843179.784503:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7766e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795680128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843179.784605:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843179.784671:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6e76b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843179.784758:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795680128 00000100:00100000:3.0:1788843179.784776:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795680128 00000100:00100000:3.0:1788843179.784841:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788843179.784852:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795680128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843179.785177:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795680128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 326us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843179.785194:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788843179.785994:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7766e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795680128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843179.786052:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7766e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795680256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843179.786118:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843179.786157:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6e76b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843179.786336:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795680256 00000100:00100000:2.0:1788843179.786390:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795680256 00000100:00100000:2.0:1788843179.786458:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788843179.786470:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795680256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843179.786719:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795680256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843179.786727:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788843179.787166:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7766e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795680256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843179.787755:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7766e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:11684:1875737795680384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843179.787867:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843179.787910:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6e76b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788843179.788030:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795680384 00000100:00100000:2.0:1788843179.788039:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795680384 00000100:00100000:2.0:1788843179.788081:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788843179.788091:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+17:11684:x1875737795680384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843179.788389:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+17:11684:x1875737795680384:12345-0@lo:502:llog_process_th.0 Request processed in 298us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843179.788398:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788843179.789400:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7766e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:11684:1875737795680384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843179.789444:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843179.789457:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843179.789460:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788843179.789468:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dab51a7d800 00000020:00000080:0.0:1788843179.789472:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788843179.789607:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7766e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:11684:1875737795680512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843179.789688:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843179.789725:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6e76b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788843179.791224:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795680512 00000100:00100000:1.0:1788843179.791247:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795680512 00000100:00100000:1.0:1788843179.791302:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788843179.791317:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+17:11684:x1875737795680512:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843179.791642:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+17:11684:x1875737795680512:12345-0@lo:502:llog_process_th.0 Request processed in 329us (1952us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843179.791650:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788843179.792209:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7766e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:11684:1875737795680512:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843179.792262:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843179.792272:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843179.792275:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788843179.792281:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788843179.793574:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788843179.793607:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788843179.793618:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914f00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914f07 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843179.793630:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914f00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914f07 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843179.793642:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788843179.793645:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab7395d800 from 7 10000000:01000000:1.0:1788843179.793669:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788843179.793704:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b0914f0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843179.793712:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b0914f0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843179.793723:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b0914f0e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843179.793746:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e8e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795680640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788843179.793799:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843179.793846:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab43a3ca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788843179.794791:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795680640 00000100:00100000:0.0:1788843179.794825:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795680640 00000100:00100000:0.0:1788843179.794908:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788843179.794919:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+17:5844:x1875737795680640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843179.794939:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843179.794961:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0914f15 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914f0e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843179.794999:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0914f15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914f0e expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843179.795014:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0914f15 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914f0e expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843179.795024:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4c00, rc 0) 00000100:00100000:0.0:1788843179.795124:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795680640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843179.795131:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1788843179.798305:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e8e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795680640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843179.798368:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b0914f0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914f15 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843179.798405:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b0914f0e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914f15 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843179.798519:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795680768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843179.802465:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843179.802553:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab43774600 going to sleep for 11 seconds 00000100:00100000:2.0:1788843179.802592:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795680768 00000100:00100000:2.0:1788843179.802602:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795680768 00000100:00100000:2.0:1788843179.802662:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788843179.802673:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795680768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843179.804122:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795680768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1442us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843179.804136:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1788843179.804225:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795680768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843179.804310:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795680896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843179.804394:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843179.804432:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab43774600 going to sleep for 11 seconds 00000100:00100000:2.0:1788843179.804491:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795680896 00000100:00100000:2.0:1788843179.804498:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795680896 00000100:00100000:2.0:1788843179.804533:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788843179.804542:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795680896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843179.804932:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795680896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 389us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843179.804940:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788843179.804994:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795680896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843179.805285:0:11687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:11687:1875737795681024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843179.805327:0:11687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843179.805392:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795681024 00000100:00100000:2.0:1788843179.805397:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795681024 00000100:00100000:2.0:1788843179.805423:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788843179.805431:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:11687:x1875737795681024:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843179.809696:0:11687:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab43774900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843179.810034:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:11687:x1875737795681024:12345-0@lo:502:llog_process_th.0 Request processed in 4591us (4695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843179.810053:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788843179.810065:0:11687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:11687:1875737795681024:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788843179.810128:0:11687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843179.810142:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843179.810144:0:11687:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788843179.810153:0:11687:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dab7395d800 00000020:00000080:3.0:1788843179.810156:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788843179.810377:0:11687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:11687:1875737795681152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843179.810465:0:11687:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843179.810517:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795681152 00000100:00100000:2.0:1788843179.810526:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795681152 00000100:00100000:3.0:1788843179.810866:0:11687:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab437749c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843179.811966:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788843179.811989:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+18:11687:x1875737795681152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843179.812299:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+18:11687:x1875737795681152:12345-0@lo:502:llog_process_th.0 Request processed in 321us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843179.812309:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788843179.813404:0:11687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:11687:1875737795681152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788843179.813456:0:11687:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843179.813468:0:11687:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843179.813471:0:11687:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788843179.813477:0:11687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788843179.813881:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788843179.813917:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843179.813930:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b0914f0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914f15 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843179.813944:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b0914f0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914f15 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843179.813989:0:5844:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788843179.813992:0:5844:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab71a20000 from 7 10000000:01000000:2.0:1788843179.813996:0:5844:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788843179.814042:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914f1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843179.814051:0:5844:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914f1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843179.814063:0:5844:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914f1c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843179.814092:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795681280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788843179.814162:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843179.814231:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab43774300 going to sleep for 11 seconds 00000100:00100000:3.0:1788843179.814618:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795681280 00000100:00100000:3.0:1788843179.814629:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795681280 00000100:00100000:3.0:1788843179.814701:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1788843179.814716:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+18:5844:x1875737795681280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843179.814734:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843179.814756:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914f23 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0914f1c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843179.814788:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914f23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0914f1c expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843179.814800:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914f23 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0914f1c expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843179.814827:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41533600, rc 0) 00000100:00100000:3.0:1788843179.814905:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795681280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843179.814912:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788843179.818579:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795681280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843179.818608:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914f1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914f23 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843179.818620:0:5844:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914f1c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914f23 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843179.818699:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795681408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843179.818761:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843179.818802:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab43774300 going to sleep for 11 seconds 00000100:00100000:3.0:1788843179.820041:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795681408 00000100:00100000:3.0:1788843179.820052:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795681408 00000100:00100000:3.0:1788843179.820125:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788843179.820136:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795681408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843179.820505:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795681408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 370us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843179.820512:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788843179.820672:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795681408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843179.820721:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795681536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843179.820773:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843179.820811:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab43774300 going to sleep for 11 seconds 00000100:00100000:2.0:1788843179.820827:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795681536 00000100:00100000:2.0:1788843179.820831:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795681536 00000100:00100000:2.0:1788843179.820863:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788843179.820870:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795681536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843179.821012:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:5844:x1875737795681536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843179.821019:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788843179.821057:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6be680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:28cf63da-daee-485f-b466-4ec68876f732:5844:1875737795681536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843179.821296:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:11688:1875737795681664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843179.821330:0:11688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843179.821378:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795681664 00000100:00100000:2.0:1788843179.821382:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795681664 00000100:00100000:2.0:1788843179.821403:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788843179.821409:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:11688:x1875737795681664:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843179.821545:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:11688:x1875737795681664:12345-0@lo:502:llog_process_th.0 Request processed in 135us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843179.821552:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788843179.821589:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab43774240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843179.821600:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:11688:1875737795681664:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788843179.821620:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843179.821629:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843179.821631:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788843179.821638:0:11688:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dab71a20000 00000020:00000080:2.0:1788843179.821645:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788843179.821708:0:11688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:11688:1875737795681792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843179.821738:0:11688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843179.821757:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795681792 00000100:00100000:2.0:1788843179.821760:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795681792 00000100:00100000:2.0:1788843179.821779:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788843179.821784:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:11688:x1875737795681792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843179.821894:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:11688:x1875737795681792:12345-0@lo:502:llog_process_th.0 Request processed in 108us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843179.821902:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788843179.821932:0:11688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab43774240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843179.821944:0:11688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6be680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:28cf63da-daee-485f-b466-4ec68876f732:11688:1875737795681792:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788843179.821962:0:11688:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843179.821967:0:11688:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843179.821968:0:11688:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788843179.821972:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788843179.822022:0:5844:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788843179.822038:0:5844:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843179.822047:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914f1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914f23 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843179.822057:0:5844:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914f1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914f23 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788843179.830153:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788843180.356815:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795682048:0@lo:400:kworker.0 00000100:00100000:2.0:1788843180.356892:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843180.356974:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843180.356995:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795682176:0@lo:400:kworker.0 00000100:00100000:2.0:1788843180.357038:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843180.357084:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795682176 00000100:00100000:2.0:1788843180.357092:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795682176 00000100:00100000:2.0:1788843180.357136:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788843180.357146:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795682176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843180.357201:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795682176:12345-0@lo:400:kworker.0 Request processed in 56us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843180.357215:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788843180.357271:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795682176:0@lo:400:kworker.0 00000100:00100000:0.0:1788843180.357756:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795681920:0@lo:400:kworker.0 00000100:00100000:0.0:1788843180.357842:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843180.357889:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795682432:0@lo:400:kworker.0 00000100:00100000:0.0:1788843180.357915:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843180.357961:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843180.357968:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795682304:0@lo:400:kworker.0 00000100:00100000:0.0:1788843180.357992:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843180.358026:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795682048 00000100:00100000:0.0:1788843180.358034:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795682048 00000100:00100000:0.0:1788843180.358096:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795681920 00000100:00100000:0.0:1788843180.358099:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795681920 00000100:00100000:0.0:1788843180.358129:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795682304 00000100:00100000:0.0:1788843180.358132:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795682304 00000100:00100000:0.0:1788843180.358149:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788843180.358162:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795682048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843180.358221:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795682048:12345-0@lo:400:kworker.0 Request processed in 59us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843180.358228:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788843180.358256:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788843180.358262:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795681920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843180.358294:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795681920:12345-0@lo:400:kworker.0 Request processed in 32us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843180.358301:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788843180.358313:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788843180.358319:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795682304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843180.358385:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795682304:12345-0@lo:400:kworker.0 Request processed in 66us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843180.358391:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1788843180.358416:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843180.358445:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795682304:0@lo:400:kworker.0 00000100:00100000:0.0:1788843180.358454:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795681920:0@lo:400:kworker.0 00000100:00100000:0.0:1788843180.358490:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795682048:0@lo:400:kworker.0 00000100:00100000:1.0:1788843180.359078:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795682432 00000100:00100000:1.0:1788843180.359086:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795682432 00000100:00100000:1.0:1788843180.359132:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788843180.359138:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795682432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843180.359184:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795682432:12345-0@lo:400:kworker.0 Request processed in 47us (1269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843180.359188:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:1.0:1788843180.359223:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7cd40000 x1875737795682432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843196 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843180.359245:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795682432:0@lo:400:kworker.0 00000100:00080000:0.0:1788843180.360538:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788843180.805740:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788843180.869719:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788843180.870191:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e8e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795682560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843180.870279:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843180.870505:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795682560 00000100:00100000:2.0:1788843180.870521:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795682560 00000100:00100000:2.0:1788843180.870604:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788843180.870616:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795682560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788843180.870662:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788843180.870774:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795682560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 160us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843180.870781:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788843180.871081:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e8e0380 x1875737795682560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843196 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843180.871105:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e8e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795682560:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788843181.828741:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843182.853187:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843183.881608:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843184.271962:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843184.272020:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843184.272071:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843184.272109:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843184.272152:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775725696 00000100:00100000:0.0:1788843184.272164:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775725696 00000100:00100000:0.0:1788843184.272253:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775725952 00000100:00100000:0.0:1788843184.272256:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775725952 00000100:00100000:0.0:1788843184.272283:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 105 00000100:00100000:0.0:1788843184.272297:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2356:x1875737775725696:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843184.272441:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2356:x1875737775725696:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 147us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843184.272450:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 105 00000100:00100000:0.0:1788843184.272472:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 106 00000100:00100000:0.0:1788843184.272480:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2356:x1875737775725952:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843184.272506:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2356:x1875737775725952:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 27us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843184.272512:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 106 00000100:00080000:0.0:1788843184.272629:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843184.272724:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775725568 00000100:00100000:2.0:1788843184.272729:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775725568 00000100:00100000:2.0:1788843184.272776:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 272 00000100:00100000:2.0:1788843184.272783:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2356:x1875737775725568:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843184.272815:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2356:x1875737775725568:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 34us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843184.272822:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 272 00000100:00100000:1.0:1788843184.275588:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775725824 00000100:00100000:1.0:1788843184.275610:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775725824 00000100:00100000:1.0:1788843184.275739:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:1.0:1788843184.275758:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2356:x1875737775725824:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843184.275926:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2356:x1875737775725824:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 175us (3905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843184.275938:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00080000:0.0:1788843184.276059:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843184.454278:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843184.457174:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e8e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795682688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843184.457294:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843184.457596:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795682688 00000100:00100000:2.0:1788843184.457613:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795682688 00000100:00100000:2.0:1788843184.457737:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788843184.457750:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795682688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788843184.457806:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788843184.457915:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795682688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 167us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843184.457922:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788843184.458148:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843184.458787:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e8e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795682688:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788843184.900680:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843185.478725:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795682816:0@lo:400:kworker.0 00000100:00100000:2.0:1788843185.478758:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795683200:0@lo:400:kworker.0 00000100:00100000:3.0:1788843185.478836:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795683072:0@lo:400:kworker.0 00000100:00100000:0.0:1788843185.478873:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795682944:0@lo:400:kworker.0 00000100:00100000:2.0:1788843185.479207:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843185.479308:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795683200 00000100:00100000:2.0:1788843185.479317:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795683200 00000100:00100000:2.0:1788843185.479398:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788843185.479409:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795683200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843185.479465:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795683200:12345-0@lo:400:kworker.0 Request processed in 58us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843185.479473:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788843185.479521:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795683200:0@lo:400:kworker.0 00000100:00100000:1.0:1788843185.481382:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843185.481488:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795682816 00000100:00100000:2.0:1788843185.481498:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795682816 00000100:00100000:3.0:1788843185.481535:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843185.481561:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788843185.481577:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3304:x1875737795682816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843185.481627:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795683072 00000100:00100000:3.0:1788843185.481634:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795683072 00000100:00100000:3.0:1788843185.481681:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788843185.481691:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795683072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843185.481749:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795683072:12345-0@lo:400:kworker.0 Request processed in 60us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843185.481757:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1788843185.481781:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843185.481811:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795683072:0@lo:400:kworker.0 00000100:00100000:2.0:1788843185.482786:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3304:x1875737795682816:12345-0@lo:400:kworker.0 Request processed in 1210us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843185.482798:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788843185.483059:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843185.483139:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795683456:0@lo:400:kworker.0 00000100:00100000:0.0:1788843185.483176:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843185.483238:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843185.483245:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795683328:0@lo:400:kworker.0 00000100:00100000:0.0:1788843185.483298:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843185.483364:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795683456 00000100:00100000:3.0:1788843185.483372:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795683456 00000100:00100000:3.0:1788843185.483434:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788843185.483442:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795683456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843185.483480:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795683456:12345-0@lo:400:kworker.0 Request processed in 41us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843185.483487:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788843185.483503:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843185.486422:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795682944 00000100:00100000:2.0:1788843185.486442:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795682944 00010000:00080000:0.0:1788843185.486508:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e6bed80 x1875737795683456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843185.486532:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795683456:0@lo:400:kworker.0 00000100:00100000:3.0:1788843185.488113:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795683328 00000100:00100000:3.0:1788843185.488127:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795683328 00000100:00100000:3.0:1788843185.488206:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788843185.488217:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795682944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843185.488258:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788843185.488272:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795683328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843185.488393:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795683328:12345-0@lo:400:kworker.0 Request processed in 124us (5093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843185.488402:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1788843185.488412:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843185.488460:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795683328:0@lo:400:kworker.0 00000100:00100000:0.0:1788843185.488474:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795682944:0@lo:400:kworker.0 00000100:00100000:3.0:1788843185.489289:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795682944:12345-0@lo:400:kworker.0 Request processed in 1072us (6331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843185.489298:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788843185.491149:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795682816:0@lo:400:kworker.0 00010000:00010000:3.0:1788843185.926073:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843185.988720:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e8e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795683584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843185.988806:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843185.989077:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795683584 00000100:00100000:1.0:1788843185.989086:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795683584 00000100:00100000:1.0:1788843185.989151:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788843185.989163:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795683584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843185.989216:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843185.989688:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795683584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843185.989699:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788843185.994553:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e8e0700 x1875737795683584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843201 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843185.994590:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e8e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795683584:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788843186.948922:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843187.972586:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843188.996576:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843189.391433:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843189.391477:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843189.391533:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843189.391571:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843189.391607:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775726336 00000100:00100000:3.0:1788843189.391629:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775726336 00000100:00100000:2.0:1788843189.391703:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775726080 00000100:00100000:2.0:1788843189.391707:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775726080 00000100:00100000:2.0:1788843189.391748:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 274 00000100:00100000:2.0:1788843189.391757:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2357:x1875737775726080:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843189.391820:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2357:x1875737775726080:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 64us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843189.391828:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 274 00000100:00100000:1.0:1788843189.392011:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775726208 00000100:00100000:1.0:1788843189.392016:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775726208 00000100:00100000:1.0:1788843189.392073:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775726464 00000100:00100000:1.0:1788843189.392076:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775726464 00000100:00100000:1.0:1788843189.392101:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 110 00000100:00100000:1.0:1788843189.392108:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2357:x1875737775726208:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843189.392142:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2357:x1875737775726208:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 34us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843189.392149:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 110 00000100:00100000:1.0:1788843189.392165:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 111 00000100:00100000:1.0:1788843189.392200:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2357:x1875737775726464:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843189.392228:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2357:x1875737775726464:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 30us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843189.392234:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 111 00000100:00080000:0.0:1788843189.392465:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788843189.392470:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843189.392790:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:3.0:1788843189.392808:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2357:x1875737775726336:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843189.392853:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2357:x1875737775726336:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 47us (1281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843189.392860:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:0.0:1788843189.572599:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e8e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795683712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843189.572667:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843189.572806:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795683712 00000100:00100000:1.0:1788843189.572814:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795683712 00000100:00100000:1.0:1788843189.572878:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788843189.572888:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795683712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843189.572922:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843189.572967:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795683712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843189.572974:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1788843189.573224:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843189.573263:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e8e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795683712:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788843190.020615:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788843190.085065:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788843190.598377:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795683840:0@lo:400:kworker.0 00000100:00100000:1.0:1788843190.598449:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843190.598509:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795684352:0@lo:400:kworker.0 00000100:00100000:1.0:1788843190.598535:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843190.598562:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788843190.598567:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795683968:0@lo:400:kworker.0 00000100:00100000:1.0:1788843190.598601:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843190.598619:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795684480:0@lo:400:kworker.0 00000100:00100000:1.0:1788843190.598641:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843190.598670:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795684352 00000100:00100000:1.0:1788843190.598677:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795684352 00000100:00100000:1.0:1788843190.598729:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795683968 00000100:00100000:1.0:1788843190.598732:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795683968 00000100:00100000:1.0:1788843190.598768:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788843190.598776:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875737795684352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843190.598824:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875737795684352:12345-0@lo:400:kworker.0 Request processed in 49us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843190.598831:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788843190.598847:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788843190.598853:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795683968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843190.598875:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795683968:12345-0@lo:400:kworker.0 Request processed in 23us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843190.598880:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788843190.598927:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795683968:0@lo:400:kworker.0 00000100:00100000:1.0:1788843190.598940:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795684352:0@lo:400:kworker.0 00000100:00100000:2.0:1788843190.599079:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795684096:0@lo:400:kworker.0 00000100:00080000:0.0:1788843190.599080:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843190.599098:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795684224:0@lo:400:kworker.0 00000100:00100000:2.0:1788843190.599110:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843190.599134:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843190.599170:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795684480 00000100:00100000:0.0:1788843190.599174:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795684480 00000100:00100000:0.0:1788843190.599224:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795684224 00000100:00100000:0.0:1788843190.599227:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795684224 00000100:00100000:0.0:1788843190.599247:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788843190.599254:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795684480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843190.599278:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795684096 00000100:00100000:1.0:1788843190.599282:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795684096 00000100:00100000:0.0:1788843190.599293:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795684480:12345-0@lo:400:kworker.0 Request processed in 39us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843190.599299:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788843190.599306:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788843190.599310:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788843190.599312:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795684096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843190.599314:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795684224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843190.599363:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795684096:12345-0@lo:400:kworker.0 Request processed in 29us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843190.599369:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788843190.599376:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795684224:12345-0@lo:400:kworker.0 Request processed in 27us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843190.599382:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1788843190.599415:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7bcaf800 x1875737795684480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843190.599426:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795684480:0@lo:400:kworker.0 00000100:00100000:1.0:1788843190.599460:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795684224:0@lo:400:kworker.0 00000100:00080000:2.0:1788843190.599701:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843190.599705:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843190.599729:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795684096:0@lo:400:kworker.0 00000100:00100000:3.0:1788843190.600559:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795683840 00000100:00100000:3.0:1788843190.600567:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795683840 00000100:00100000:3.0:1788843190.600627:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788843190.600636:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3304:x1875737795683840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843190.600705:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3304:x1875737795683840:12345-0@lo:400:kworker.0 Request processed in 70us (2255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843190.600711:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788843190.601498:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795683840:0@lo:400:kworker.0 00010000:00010000:0.0:1788843191.045849:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843191.109261:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843191.109295:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e8e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795684608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843191.109382:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843191.109885:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795684608 00000100:00100000:1.0:1788843191.109894:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795684608 00000100:00100000:1.0:1788843191.109948:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788843191.109958:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795684608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843191.109991:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843191.110055:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795684608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843191.110375:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1788843191.111441:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e8e1500 x1875737795684608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843207 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843191.111464:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e8e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795684608:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788843192.069200:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843193.092546:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843194.117071:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843194.514870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843194.514928:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843194.515084:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775726592 00000100:00100000:0.0:1788843194.515093:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775726592 00000100:00100000:0.0:1788843194.515155:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 276 00000100:00100000:0.0:1788843194.515167:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab489e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2357:x1875737775726592:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843194.515247:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab489e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2357:x1875737775726592:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 82us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843194.515273:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 276 00000100:00100000:2.0:1788843194.515821:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775726720 00000100:00100000:2.0:1788843194.515828:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775726720 00000100:00100000:2.0:1788843194.515887:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 115 00000100:00100000:2.0:1788843194.515896:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2357:x1875737775726720:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843194.515946:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2357:x1875737775726720:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 52us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843194.515953:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 115 00000100:00080000:0.0:1788843194.516026:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843194.528513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843194.528638:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843194.528647:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775726848 00000100:00100000:3.0:1788843194.528663:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775726848 00000100:00100000:3.0:1788843194.528770:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:3.0:1788843194.528786:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2355:x1875737775726848:12345-192.168.203.29@tcp:9:kworker.0 00000020:00000080:3.0:1788843194.528881:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914e5f 00000100:00080000:3.0:1788843194.528895:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8dab77a7e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788843194.528960:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1788843194.529249:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775726976 00000100:00100000:1.0:1788843194.529256:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775726976 00000100:00100000:1.0:1788843194.529331:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 116 00000100:00100000:1.0:1788843194.529380:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2356:x1875737775726976:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843194.529385:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73927800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+2:2355:x1875737775726848:12345-192.168.203.29@tcp:9:kworker.0 Request processed in 602us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843194.529396:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:1.0:1788843194.529426:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2356:x1875737775726976:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 86us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843194.529436:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 116 00000100:00080000:2.0:1788843194.529630:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843194.529637:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788843194.529723:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843194.692690:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795684736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843194.692802:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843194.693082:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795684736 00000100:00100000:2.0:1788843194.693096:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795684736 00000100:00100000:2.0:1788843194.693195:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788843194.693207:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795684736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788843194.693262:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788843194.693386:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843194.694660:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e8e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795684736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843194.694661:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73926d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795684736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1450us (1853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843194.694678:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00010000:3.0:1788843195.141791:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843195.718100:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795685120:0@lo:400:kworker.0 00000100:00100000:3.0:1788843195.718183:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843195.718253:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843195.718260:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795685248:0@lo:400:kworker.0 00000100:00100000:3.0:1788843195.718287:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843195.718360:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795685120 00000100:00100000:2.0:1788843195.718368:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795685120 00000100:00100000:2.0:1788843195.718435:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788843195.718447:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795685120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843195.718514:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795685120:12345-0@lo:400:kworker.0 Request processed in 69us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843195.718522:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788843195.718566:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795685120:0@lo:400:kworker.0 00000100:00100000:1.0:1788843195.718671:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795684864:0@lo:400:kworker.0 00000100:00100000:1.0:1788843195.718702:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843195.718730:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795685376:0@lo:400:kworker.0 00000100:00100000:1.0:1788843195.718750:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843195.718770:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788843195.718776:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795684992:0@lo:400:kworker.0 00000100:00100000:1.0:1788843195.718796:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843195.718812:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795685504:0@lo:400:kworker.0 00000100:00100000:1.0:1788843195.718833:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843195.718857:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795685248 00000100:00100000:1.0:1788843195.718875:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795685248 00000100:00100000:1.0:1788843195.718901:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795685504 00000100:00100000:1.0:1788843195.718903:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795685504 00000100:00100000:1.0:1788843195.718924:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788843195.718931:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795685248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843195.718967:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795685248:12345-0@lo:400:kworker.0 Request processed in 36us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843195.718974:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788843195.718988:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788843195.718994:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795685504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843195.719026:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795685504:12345-0@lo:400:kworker.0 Request processed in 32us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843195.719032:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788843195.719049:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795685376 00000100:00100000:1.0:1788843195.719051:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795685376 00000100:00100000:1.0:1788843195.719072:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795684992 00000100:00100000:1.0:1788843195.719075:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795684992 00000100:00100000:1.0:1788843195.719088:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788843195.719095:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875737795685376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843195.719124:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875737795685376:12345-0@lo:400:kworker.0 Request processed in 29us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843195.719141:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788843195.719153:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788843195.719160:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795684992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843195.719190:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795684992:12345-0@lo:400:kworker.0 Request processed in 31us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843195.719196:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788843195.719236:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795684992:0@lo:400:kworker.0 00010000:00080000:1.0:1788843195.719249:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e6bf100 x1875737795685504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843211 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843195.719259:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795685504:0@lo:400:kworker.0 00000100:00100000:1.0:1788843195.719268:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795685376:0@lo:400:kworker.0 00000100:00080000:3.0:1788843195.719373:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843195.719378:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843195.719442:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795684864 00000100:00100000:2.0:1788843195.719448:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795684864 00000100:00100000:2.0:1788843195.719477:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788843195.719484:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3304:x1875737795684864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843195.719548:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3304:x1875737795684864:12345-0@lo:400:kworker.0 Request processed in 64us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843195.719560:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1788843195.719601:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795685248:0@lo:400:kworker.0 00000100:00100000:3.0:1788843195.719852:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795684864:0@lo:400:kworker.0 00010000:00010000:0.0:1788843196.168566:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843196.231377:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788843196.231403:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e8e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795685632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843196.231476:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843196.232465:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795685632 00000100:00100000:1.0:1788843196.232475:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795685632 00000100:00100000:1.0:1788843196.232538:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788843196.232548:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795685632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843196.232598:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843196.232671:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795685632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843196.232678:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788843196.232869:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e8e1500 x1875737795685632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843212 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843196.232888:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e8e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795685632:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788843197.188656:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843198.212909:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788843198.401572:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fb38c5ab-0241-4970-81c2-7e93fb808128 00000020:00000080:1.0:1788843198.401586:0:6719:0:(genops.c:885:class_export_put()) final put ffff8dab77a7d000/fb38c5ab-0241-4970-81c2-7e93fb808128 00000020:00000080:1.0:1788843198.401639:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab77a7d000/fb38c5ab-0241-4970-81c2-7e93fb808128 for lustre-OST0000 00000020:00000080:1.0:1788843198.401707:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab77a7e800 for lustre-OST0000 00010000:00010000:3.0:1788843199.239061:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843199.631125:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843199.631174:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843199.631303:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775727232 00000100:00100000:3.0:1788843199.631315:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775727232 00000100:00100000:3.0:1788843199.631407:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 120 00000100:00100000:3.0:1788843199.631418:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2356:x1875737775727232:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843199.631467:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775727104 00000100:00100000:0.0:1788843199.631471:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775727104 00000100:00100000:3.0:1788843199.631499:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2356:x1875737775727232:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 83us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843199.631507:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 120 00000100:00100000:0.0:1788843199.631512:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 278 00000100:00100000:0.0:1788843199.631518:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2356:x1875737775727104:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843199.631554:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2356:x1875737775727104:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 35us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843199.631561:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 278 00000100:00100000:1.0:1788843199.632064:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843199.632150:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775727360 00000100:00100000:0.0:1788843199.632155:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775727360 00000100:00080000:3.0:1788843199.632292:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843199.634404:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 121 00000100:00100000:2.0:1788843199.634433:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2356:x1875737775727360:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843199.634526:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2356:x1875737775727360:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 109us (3315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843199.634533:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 121 00000100:00100000:0.0:1788843199.815145:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843199.815167:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795685760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843199.815233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843199.815369:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795685760 00000100:00100000:0.0:1788843199.815379:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795685760 00000100:00100000:0.0:1788843199.815448:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788843199.815459:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795685760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843199.815502:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843199.815557:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73927b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795685760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843199.815565:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788843199.815589:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843199.815620:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795685760:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788843200.264434:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788843200.325804:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788843200.837509:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795686144:0@lo:400:kworker.0 00000100:00100000:0.0:1788843200.837590:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843200.837650:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843200.837657:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795686272:0@lo:400:kworker.0 00000100:00100000:3.0:1788843200.837664:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795685888:0@lo:400:kworker.0 00000100:00100000:3.0:1788843200.837698:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843200.837722:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795686400:0@lo:400:kworker.0 00000100:00100000:3.0:1788843200.837765:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843200.837784:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788843200.837790:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795686016:0@lo:400:kworker.0 00000100:00100000:3.0:1788843200.837811:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843200.837826:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795686528:0@lo:400:kworker.0 00000100:00100000:3.0:1788843200.837847:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843200.837872:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843200.837875:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795686144 00000100:00100000:3.0:1788843200.837881:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795686144 00000100:00100000:0.0:1788843200.837895:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795686400 00000100:00100000:0.0:1788843200.837899:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795686400 00000100:00100000:1.0:1788843200.838000:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795685888 00000100:00100000:1.0:1788843200.838004:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795685888 00000100:00100000:1.0:1788843200.838034:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788843200.838043:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3304:x1875737795685888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843200.838103:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3304:x1875737795685888:12345-0@lo:400:kworker.0 Request processed in 50us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843200.838117:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788843200.838149:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795686528 00000100:00100000:1.0:1788843200.838153:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795686528 00000100:00100000:1.0:1788843200.838174:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795686272 00000100:00100000:1.0:1788843200.838177:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795686272 00000100:00100000:1.0:1788843200.838193:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788843200.838199:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795686528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843200.838230:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795686528:12345-0@lo:400:kworker.0 Request processed in 31us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843200.838236:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788843200.838247:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788843200.838253:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795686272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843200.838279:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73925c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795686272:12345-0@lo:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843200.838284:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788843200.838388:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795686016 00000100:00100000:0.0:1788843200.838392:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795686016 00000100:00100000:1.0:1788843200.845121:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788843200.845145:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875737795686400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843200.845233:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875737795686400:12345-0@lo:400:kworker.0 Request processed in 100us (7466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843200.852398:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788843200.852429:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795686144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843200.852532:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73924700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795686144:12345-0@lo:400:kworker.0 Request processed in 119us (14941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843200.852540:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788843200.852571:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788843200.852577:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795686016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843200.852608:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795686016:12345-0@lo:400:kworker.0 Request processed in 32us (14797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843200.852614:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788843200.854540:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788843200.854670:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73925180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795686016:0@lo:400:kworker.0 00010000:00080000:1.0:1788843200.854690:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab73924380 x1875737795686528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788843216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843200.854701:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795686528:0@lo:400:kworker.0 00000100:00100000:1.0:1788843200.854712:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795685888:0@lo:400:kworker.0 00000100:00100000:1.0:1788843200.854758:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73927480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795686400:0@lo:400:kworker.0 00000100:00100000:1.0:1788843200.854831:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73926300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795686272:0@lo:400:kworker.0 00000100:00100000:1.0:1788843200.854844:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73925f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795686144:0@lo:400:kworker.0 00000100:00080000:1.0:1788843200.854891:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788843200.854897:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788843201.286098:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843201.349202:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843201.353572:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e8e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795686656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843201.353686:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843201.359125:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795686656 00000100:00100000:3.0:1788843201.359153:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795686656 00000100:00100000:3.0:1788843201.359547:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788843201.359563:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795686656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843201.359626:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788843201.359766:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795686656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 206us (6080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843201.359776:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:2.0:1788843201.360320:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab6e8e0380 x1875737795686656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843217 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843201.360366:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e8e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795686656:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788843201.628163:0:11851:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 00:53:20 (1788843200) 00010000:00010000:0.0:1788843202.309708:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843203.332765:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843203.520048:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843203.522053:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775727488 00000100:00100000:3.0:1788843203.522085:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775727488 00000100:00100000:3.0:1788843203.522216:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:3.0:1788843203.522234:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+5:10231:x1875737775727488:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843203.522265:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843203.522467:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914f2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c60708484f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.522567:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0914f31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.522584:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0914f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.522599:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0914f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843203.522644:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788843203.522649:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788843203.522700:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0914f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.522732:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914f2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708484f expref: 7 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.522758:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0914f31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708484f expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.522768:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43e63c00) 00010000:00010000:3.0:1788843203.523030:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843203.523037:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41532a00, rc 0) 00000100:00100000:3.0:1788843203.523158:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73927100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:10231:x1875737775727488:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 929us (3122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843203.523168:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00080000:1.0:1788843203.523624:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843203.542180:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843203.542313:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775727616 00000100:00100000:3.0:1788843203.542329:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775727616 00000100:00100000:3.0:1788843203.542475:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:3.0:1788843203.542500:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:10232:x1875737775727616:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843203.542540:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843203.542572:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914f38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084856 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.542683:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0914f3f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.542703:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0914f3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.542718:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0914f3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.542736:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914f46 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.542744:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914f46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.542750:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914f46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543094:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054a00/0xc6b8ac1b0914f4d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543106:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054a00/0xc6b8ac1b0914f4d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543114:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054a00/0xc6b8ac1b0914f4d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843203.543153:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788843203.543158:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788843203.543179:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054a00/0xc6b8ac1b0914f4d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543192:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0914f3f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543200:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0914f3f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543208:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0914f3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543214:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843203.543220:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0914f3f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543229:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0914f3f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543243:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43e63c00) 00010000:00010000:3.0:1788843203.543253:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843203.543262:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0914f3f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543269:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0914f3f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543288:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914f46 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543295:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914f46 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543300:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914f46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543305:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843203.543308:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914f46 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543314:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914f46 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543323:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8dab43e63700) 00010000:00010000:3.0:1788843203.543325:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843203.543328:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914f46 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543335:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914f46 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543441:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0914f38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084856 expref: 8 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543473:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054a00/0xc6b8ac1b0914f4d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084856 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843203.543482:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dab43e63a00) 00010000:00010000:3.0:1788843203.543484:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843203.543487:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82054a00, rc 0) 00000100:00100000:3.0:1788843203.543576:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+7:10232:x1875737775727616:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 1090us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843203.543585:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:0.0:1788843203.550523:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843203.550703:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775727872 00000100:00100000:1.0:1788843203.550722:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775727872 00000100:00100000:1.0:1788843203.550810:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:1.0:1788843203.550823:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:10232:x1875737775727872:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788843203.550844:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843203.550867:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0914f54 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c60708485d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.550959:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0914f5b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.550974:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0914f5b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.550985:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0914f5b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.551050:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914f62 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.551059:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914f62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.551094:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914f62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.551852:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0914f69 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.551868:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0914f69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.551877:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0914f69 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843203.551889:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788843203.554643:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0914f5b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.554661:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0914f5b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.554669:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0914f5b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.554675:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933ac00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843203.554680:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0914f5b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.554687:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0914f5b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.554705:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dab43e63a00) 00010000:00010000:1.0:1788843203.554709:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843203.554733:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0914f5b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.554740:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0914f5b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.554758:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914f62 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.554764:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914f62 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.554769:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914f62 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.554774:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843203.554777:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914f62 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.554783:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914f62 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.554792:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8dab61f39e00) 00010000:00010000:1.0:1788843203.554794:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843203.554797:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914f62 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.554803:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0914f62 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.555409:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0914f54 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708485d expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.555439:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0914f69 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708485d expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843203.555446:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab61f39d00) 00010000:00010000:1.0:1788843203.555449:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843203.555451:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b600, rc 0) 00000100:00100000:1.0:1788843203.555530:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+9:10232:x1875737775727872:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 4709us (5042us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788843203.555539:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:1.0:1788843203.559165:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843203.559571:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775728000 00000100:00100000:3.0:1788843203.559592:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775728000 00000100:00100000:3.0:1788843203.559698:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:3.0:1788843203.559711:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+9:10232:x1875737775728000:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788843203.560158:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+9:10232:x1875737775728000:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 Request processed in 447us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843203.560167:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 35 00010000:00010000:3.0:1788843204.357520:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843204.423778:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788843204.751307:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843204.751442:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843204.751482:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843204.751596:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775728128 00000100:00100000:2.0:1788843204.751606:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775728128 00000100:00100000:2.0:1788843204.751660:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 280 00000100:00100000:2.0:1788843204.751670:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2357:x1875737775728128:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843204.751735:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2357:x1875737775728128:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 67us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843204.751743:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 280 00000100:00100000:3.0:1788843204.752257:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775728256 00000100:00100000:3.0:1788843204.752264:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775728256 00000100:00100000:1.0:1788843204.752309:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775728384 00000100:00100000:1.0:1788843204.752314:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775728384 00000100:00100000:1.0:1788843204.752429:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 125 00000100:00100000:1.0:1788843204.752439:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2357:x1875737775728384:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843204.752508:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2357:x1875737775728384:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 71us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843204.752515:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 125 00000100:00100000:1.0:1788843204.752610:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 126 00000100:00100000:1.0:1788843204.752617:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+9:2357:x1875737775728256:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843204.752649:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+9:2357:x1875737775728256:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 32us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843204.752655:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 126 00000100:00080000:0.0:1788843204.753029:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843204.932920:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843204.932949:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795686784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843204.933150:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843204.933370:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795686784 00000100:00100000:0.0:1788843204.933379:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795686784 00000100:00100000:0.0:1788843204.933443:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788843204.933453:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795686784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843204.933499:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843204.933558:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795686784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843204.933566:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:1.0:1788843204.934140:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843204.934190:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795686784:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788843205.385854:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843205.474654:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843205.474807:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775728512 00000100:00100000:0.0:1788843205.474819:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775728512 00000100:00100000:0.0:1788843205.474917:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:0.0:1788843205.474927:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+9:10274:x1875737775728512:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1788843205.474949:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843205.474971:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0914f77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084864 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475035:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914f7e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475050:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914f7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475077:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914f7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475091:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914f85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475098:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914f85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475115:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914f85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475307:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914f7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475315:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914f7e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475323:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914f7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475329:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843205.475333:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914f7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475367:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914f7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475382:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43e63c00) 00010000:00010000:0.0:1788843205.475385:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843205.475390:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914f7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475396:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0914f7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475412:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914f85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475419:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914f85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475432:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914f85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475438:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843205.475441:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914f85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475448:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914f85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475456:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8dab43ece400) 00010000:00010000:0.0:1788843205.475459:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843205.475462:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914f85 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475468:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914f85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475503:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0914f77 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084864 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475515:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43e63c00) 00010000:00010000:0.0:1788843205.475517:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843205.475521:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0914f77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084864 expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.475531:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c5800, rc 0) 00000100:00100000:0.0:1788843205.475614:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+9:10274:x1875737775728512:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 688us (972us total) trans 0 rc 301/301 00000100:00100000:0.0:1788843205.475631:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00080000:3.0:1788843205.475909:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843205.482463:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843205.482540:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775728768 00000100:00100000:3.0:1788843205.482560:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775728768 00000100:00100000:3.0:1788843205.482624:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:3.0:1788843205.482635:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+9:10274:x1875737775728768:12345-192.168.203.29@tcp:36:lfs.0 00010000:00010000:3.0:1788843205.482694:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843205.482721:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0914f31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708484f expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.482738:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43e63c00) 00010000:00010000:3.0:1788843205.482748:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843205.482964:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914f8c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.482979:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914f8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.482989:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914f8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.483001:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914f93 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.483009:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914f93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.483015:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914f93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843205.483955:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788843205.483973:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914f8c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.483983:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914f8c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.483991:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914f8c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.484005:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843205.484010:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914f8c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.484019:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914f8c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.484033:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:3.0:1788843205.484037:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843205.484042:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914f8c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.484048:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914f8c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843205.484084:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079d53fd4 reply state 000000003a7947de transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914f93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843205.484094:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788843205.484217:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+10:10274:x1875737775728768:12345-192.168.203.29@tcp:36:lfs.0 Request processed in 1581us (1759us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788843205.484225:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 37 00010000:00010000:3.0:1788843205.493646:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914f93 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.493664:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914f93 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.493672:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914f93 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.493692:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843205.493698:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914f93 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.493706:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914f93 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.493727:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8dab43e63500) 00010000:00010000:3.0:1788843205.493730:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843205.493734:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914f93 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.493741:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914f93 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843205.585576:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843205.585941:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775728896 00000100:00100000:0.0:1788843205.585953:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775728896 00000100:00100000:0.0:1788843205.586020:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 38 00000100:00100000:0.0:1788843205.586031:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+9:10282:x1875737775728896:12345-192.168.203.29@tcp:101:lctl.0 00010000:00010000:0.0:1788843205.586056:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843205.586090:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0914f9a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c60708486b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.586248:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914fa1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.586264:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.586275:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843205.587139:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788843205.587146:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843205.587197:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914fa1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843205.587228:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0914f9a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708486b expref: 11 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843205.587250:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914fa1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708486b expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843205.587260:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43ece400) 00010000:00010000:2.0:1788843205.587263:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843205.587268:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4000, rc 0) 00000100:00100000:2.0:1788843205.587448:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+10:10282:x1875737775728896:12345-192.168.203.29@tcp:101:lctl.0 Request processed in 1417us (1879us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843205.587456:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 38 00000100:00100000:1.0:1788843205.646930:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843205.647024:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775729024 00000100:00100000:3.0:1788843205.647034:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775729024 00000100:00100000:3.0:1788843205.647119:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:3.0:1788843205.647131:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+10:10288:x1875737775729024:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1788843205.647154:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843205.647177:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914fa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084872 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647255:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914faf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647272:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914faf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647285:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914faf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647316:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914fb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647324:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647331:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647472:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0914fbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647494:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0914fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647501:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0914fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843205.647718:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788843205.647722:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788843205.647764:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0914fbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647777:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914faf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647784:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914faf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647791:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914faf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647807:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843205.647811:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914faf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647819:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914faf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647832:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43ece400) 00010000:00010000:3.0:1788843205.647835:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843205.647839:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914faf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647844:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0914faf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647859:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647864:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914fb6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647870:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647874:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843205.647877:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647881:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914fb6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647898:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8dab43e63500) 00010000:00010000:3.0:1788843205.647900:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843205.647903:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914fb6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647908:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0914fb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647940:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914fa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084872 expref: 12 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647953:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0914fbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084872 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.647960:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:3.0:1788843205.647962:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788843205.647964:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82054200, rc 0) 00000100:00100000:3.0:1788843205.648037:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+11:10288:x1875737775729024:12345-192.168.203.29@tcp:101:bash.0 Request processed in 908us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843205.648045:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:3.0:1788843205.659593:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843205.659844:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775729280 00000100:00100000:1.0:1788843205.659855:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775729280 00000100:00100000:1.0:1788843205.659924:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:1.0:1788843205.659934:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+11:10288:x1875737775729280:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:1.0:1788843205.659957:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843205.659980:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0914fc4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084879 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.660120:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0914fcb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.660136:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0914fcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.660146:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0914fcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.660215:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0914fd2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.660224:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0914fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.660231:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0914fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788843205.661291:0:5848:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788843205.663027:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914fd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.663047:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.663070:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.663181:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0914fcb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.663189:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0914fcb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.663195:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0914fcb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.663201:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933ae00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843205.663206:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0914fcb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.663214:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0914fcb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.663230:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:1.0:1788843205.663233:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843205.663238:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0914fcb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.663261:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0914fcb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843205.663291:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6222f05 reply state 00000000e41a0777 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0914fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843205.663301:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788843205.663563:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0914fc4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084879 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.663588:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084879 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.663596:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:1.0:1788843205.663598:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843205.663601:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933be00, rc 0) 00000100:00100000:1.0:1788843205.664467:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+14:10288:x1875737775729280:12345-192.168.203.29@tcp:101:bash.0 Request processed in 4529us (4878us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788843205.664478:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:3.0:1788843205.669459:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843205.669788:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775729408 00000100:00100000:1.0:1788843205.669798:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775729408 00000100:00100000:1.0:1788843205.669847:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:1.0:1788843205.669855:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2355:x1875737775729408:12345-192.168.203.29@tcp:8:bash.0 00010000:00080000:1.0:1788843205.669885:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp t0 exp 0000000000000000 cur 329 last 0 00000020:00000080:1.0:1788843205.669917:0:6692:0:(genops.c:1385:class_connect()) connect: client fb38c5ab-0241-4970-81c2-7e93fb808128, cookie 0xc6b8ac1b0914fe7 00002000:00100000:1.0:1788843205.669929:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fb38c5ab-0241-4970-81c2-7e93fb808128/ffff8dab452b1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788843205.669965:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788843205.670196:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788843205.670227:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8dab452b3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843205.670292:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2355:x1875737775729408:12345-192.168.203.29@tcp:8:bash.0 Request processed in 436us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843205.670300:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00010000:00010000:2.0:1788843205.671204:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0914fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843205.671218:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0914fd2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843205.671226:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0914fd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843205.671232:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843205.671236:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0914fd2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843205.671243:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0914fd2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843205.671272:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab61f39600) 00010000:00010000:2.0:1788843205.671276:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843205.671281:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0914fd2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843205.671287:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0914fd2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843205.676080:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843205.676377:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775729536 00000100:00100000:1.0:1788843205.676389:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775729536 00000100:00100000:1.0:1788843205.676466:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:1.0:1788843205.676489:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:0:x1875737775729536:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:1.0:1788843205.676508:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843205.676536:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b0914fee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084880 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788843205.676572:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843205.676595:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=329s v=(0 0) 00010000:00010000:1.0:1788843205.676600:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843205.676610:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b0914fee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084880 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.676631:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b0914fee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084880 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.676645:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b000, rc 0) 00000100:00100000:1.0:1788843205.676718:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73924380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:0:x1875737775729536:12345-192.168.203.29@tcp:101:bash.0 Request processed in 232us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843205.676743:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00080000:3.0:1788843205.677371:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843205.685428:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843205.685571:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775729664 00000100:00100000:1.0:1788843205.685581:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775729664 00000100:00100000:1.0:1788843205.685650:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:1.0:1788843205.685662:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:10288:x1875737775729664:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:1.0:1788843205.685680:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843205.685700:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e7955cc1/0xc6b8ac1b0914ff5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084887 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.685736:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b0914fee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084880 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.685745:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843205.685750:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843205.685755:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7955cc1/0xc6b8ac1b0914ff5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084887 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.685792:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b0914fee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084880 expref: 8 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.685806:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b0914fee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084880 expref: 8 pid: 6694 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843205.685820:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1875737795686912:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843205.685914:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab73b8ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843205.691248:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843205.691835:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1875737795686912:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843205.691869:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e7955cc1/0xc6b8ac1b0914ff5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084887 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.691891:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933ae00, rc 0) 00000100:00100000:1.0:1788843205.691954:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+8:10288:x1875737775729664:12345-192.168.203.29@tcp:101:bash.0 Request processed in 6295us (6543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843205.691963:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:3.0:1788843205.692194:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775729792 00000100:00100000:3.0:1788843205.692203:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775729792 00010000:00010000:3.0:1788843205.692240:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b0914fee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084880 expref: 8 pid: 6694 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843205.692295:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:3.0:1788843205.692305:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2359:x1875737775729792:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843205.692319:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843205.693616:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b0914fee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084880 expref: 8 pid: 6694 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.693710:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b0914fee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084880 expref: 8 pid: 6694 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.693738:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b0914fee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084880 expref: 8 pid: 6694 timeout: 429 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.693756:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843205.693760:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843205.693768:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7955cc1/0xc6b8ac1b0914ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084887 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.693778:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e7955cc1/0xc6b8ac1b0914ff5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084887 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.693819:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e7955cc1/0xc6b8ac1b0914ff5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084887 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843205.693834:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc47100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1875737795687040:192.168.203.29@tcp:105: 00000100:00100000:3.0:1788843205.693919:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab77787840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843205.699230:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843205.699576:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc47100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1875737795687040:192.168.203.29@tcp:105: 00010000:00010000:3.0:1788843205.699600:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843205.699655:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73925180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2359:x1875737775729792:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 7352us (8417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843205.699664:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:1.0:1788843205.702598:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775730048 00000100:00100000:1.0:1788843205.702614:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775730048 00000100:00100000:1.0:1788843205.703027:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:1.0:1788843205.703040:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+13:10288:x1875737775730048:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:1.0:1788843205.703528:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+14:10288:x1875737775730048:12345-192.168.203.29@tcp:35:bash.0 Request processed in 490us (4308us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788843205.703537:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:2.0:1788843205.793955:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843205.794204:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775730304 00000100:00100000:3.0:1788843205.794220:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775730304 00000100:00100000:3.0:1788843205.794323:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:3.0:1788843205.794336:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+14:10298:x1875737775730304:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843205.794426:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843205.794457:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914ffc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c60708488e expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843205.794606:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788843205.794989:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914ffc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708488e expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.795009:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43ece400) 00010000:00010000:3.0:1788843205.795012:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843205.795020:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0914ffc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708488e expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.795042:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82055800, rc 0) 00000100:00100000:3.0:1788843205.795485:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+15:10298:x1875737775730304:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1147us (1542us total) trans 4294967313 rc 301/301 00000100:00100000:3.0:1788843205.795496:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:0.0:1788843205.800126:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843205.800221:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775730560 00000100:00100000:3.0:1788843205.800234:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775730560 00000100:00100000:3.0:1788843205.800310:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:3.0:1788843205.800323:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+15:10298:x1875737775730560:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:3.0:1788843205.800955:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+16:10298:x1875737775730560:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 631us (843us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788843205.800966:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:0.0:1788843205.875067:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843205.875204:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775730688 00000100:00100000:2.0:1788843205.875222:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775730688 00000100:00100000:2.0:1788843205.875310:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:2.0:1788843205.875323:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+16:10304:x1875737775730688:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843205.875403:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843205.875438:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b091500a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084895 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843205.875566:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0915011 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843205.875587:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0915011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843205.875604:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0915011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843205.875667:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788843205.875686:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843205.875721:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0915011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843205.875759:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b091500a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084895 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843205.875783:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0915011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084895 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843205.875793:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:2.0:1788843205.875796:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843205.875801:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88000, rc 0) 00000100:00100000:2.0:1788843205.875888:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+17:10304:x1875737775730688:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 568us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843205.875895:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:2.0:1788843205.882740:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843205.882861:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775730944 00000100:00100000:1.0:1788843205.882877:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775730944 00000100:00100000:1.0:1788843205.882951:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:1.0:1788843205.882962:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+17:10304:x1875737775730944:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1788843205.882982:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843205.883003:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915018 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c60708489c expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.883106:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091501f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.883120:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091501f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.883147:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091501f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843205.883157:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788843205.883283:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915018 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708489c expref: 20 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.883315:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091501f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708489c expref: 19 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.883324:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:1.0:1788843205.883327:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843205.883331:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933a000, rc 0) 00000100:00100000:1.0:1788843205.883452:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+19:10304:x1875737775730944:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 491us (725us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788843205.883460:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:0.0:1788843205.886285:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843205.888206:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843205.888383:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775731328 00000100:00100000:3.0:1788843205.888397:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775731328 00000100:00100000:3.0:1788843205.888497:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:3.0:1788843205.888510:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+19:2357:x1875737775731328:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843205.888534:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843205.888571:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091501f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708489c expref: 19 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843205.888613:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:3.0:1788843205.888632:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843205.888702:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775731200 00000100:00100000:3.0:1788843205.888720:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+18:2357:x1875737775731328:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 210us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843205.888723:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775731200 00000100:00100000:3.0:1788843205.888734:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:1.0:1788843205.888832:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:1.0:1788843205.888845:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+18:10304:x1875737775731200:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1788843205.888871:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843205.888895:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b091502d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070848a3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.888989:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915034 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.889026:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915034 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.889039:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915034 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843205.889052:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788843205.889182:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b091502d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848a3 expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.889215:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915034 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848a3 expref: 20 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.889224:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:1.0:1788843205.889227:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788843205.889231:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b400, rc 0) 00000100:00100000:1.0:1788843205.889287:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+20:10304:x1875737775731200:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 445us (3015us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788843205.889294:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:0.0:1788843205.894109:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843205.894184:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775731456 00000100:00100000:1.0:1788843205.894194:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775731456 00000100:00100000:1.0:1788843205.894252:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:1.0:1788843205.894263:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2358:x1875737775731456:12345-192.168.203.29@tcp:1:lfs.0 00010000:00010000:1.0:1788843205.894300:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073740507/0xc6b8ac1b0915042 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.894321:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e7955cc1/0xc6b8ac1b0914ff5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084887 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.894380:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788843205.894384:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843205.894388:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073740507/0xc6b8ac1b0915042 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.894422:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e7955cc1/0xc6b8ac1b0914ff5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084887 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843205.894436:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e7955cc1/0xc6b8ac1b0914ff5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084887 expref: 7 pid: 6692 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843205.894449:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1875737795687168:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843205.894540:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab73b8ecc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843205.899385:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843205.899764:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775731584 00000100:00100000:0.0:1788843205.899774:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775731584 00002000:00100000:0.0:1788843205.899829:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8dab6e6bdf80 x1875737775731584/t0(0) o4->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:576/0 lens 504/0 e 0 to 0 dl 1788843216 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788843205.899858:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab6e6bdf80 with x1875737775731584 ext(0->12) 00010000:00010000:0.0:1788843205.899868:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e7955cc1/0xc6b8ac1b0914ff5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084887 expref: 8 pid: 6692 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843205.899885:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e7955cc1/0xc6b8ac1b0914ff5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084887 expref: 8 pid: 6692 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843205.899893:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8dab6e6bdf80 00000100:00100000:0.0:1788843205.899934:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:0.0:1788843205.899944:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2359:x1875737775731584:12345-192.168.203.29@tcp:4:lfs.0 00000100:00100000:1.0:1788843205.900408:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1875737795687168:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843205.900434:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073740507/0xc6b8ac1b0915042 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843205.960000:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795687552:0@lo:400:kworker.0 00000100:00100000:3.0:1788843205.960080:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843205.960148:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843205.960155:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795687680:0@lo:400:kworker.0 00000100:00100000:3.0:1788843205.960183:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843205.960223:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795687552 00000100:00100000:3.0:1788843205.960245:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795687552 00000100:00100000:3.0:1788843205.960319:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788843205.960330:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795687552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843205.960409:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795687552:12345-0@lo:400:kworker.0 Request processed in 80us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843205.960417:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788843205.960444:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795687680 00000100:00100000:3.0:1788843205.960447:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795687680 00000100:00100000:3.0:1788843205.960484:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788843205.960492:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795687680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843205.960665:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e848000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795687680:12345-0@lo:400:kworker.0 Request processed in 173us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843205.960671:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1788843205.960689:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843205.960716:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795687680:0@lo:400:kworker.0 00000100:00100000:3.0:1788843205.960728:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795687552:0@lo:400:kworker.0 00000100:00100000:2.0:1788843205.960819:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795687424:0@lo:400:kworker.0 00000100:00100000:2.0:1788843205.960851:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843205.960891:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795687936:0@lo:400:kworker.0 00000100:00100000:2.0:1788843205.960912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843205.960940:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788843205.960946:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795687296:0@lo:400:kworker.0 00000100:00100000:2.0:1788843205.960973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843205.961067:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795687424 00000100:00100000:3.0:1788843205.961080:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795687424 00000100:00100000:3.0:1788843205.961116:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788843205.961123:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795687424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843205.961156:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795687424:12345-0@lo:400:kworker.0 Request processed in 33us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843205.961162:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788843205.966817:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795687936 00000100:00100000:3.0:1788843205.966835:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795687936 00000100:00100000:3.0:1788843205.966929:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788843205.966940:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795687936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843205.967045:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795687936:12345-0@lo:400:kworker.0 Request processed in 107us (6130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843205.967052:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1788843205.967214:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843205.970749:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795687808:0@lo:400:kworker.0 00000100:00100000:0.0:1788843205.970823:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843205.970888:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795687424:0@lo:400:kworker.0 00000100:00100000:0.0:1788843205.970916:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e849c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795687936:0@lo:400:kworker.0 00000100:00100000:3.0:1788843205.971426:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795687808 00000100:00100000:3.0:1788843205.971433:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795687808 00000100:00100000:3.0:1788843205.971626:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788843205.971636:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795687808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843205.971696:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795687808:12345-0@lo:400:kworker.0 Request processed in 62us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843205.972139:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1788843205.972387:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843205.972421:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e849500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795687808:0@lo:400:kworker.0 00000100:00100000:1.0:1788843205.976946:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795687296 00000100:00100000:1.0:1788843205.976962:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795687296 00000100:00100000:0.0:1788843205.977592:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788843205.977605:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3305:x1875737795687296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843205.977699:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3305:x1875737795687296:12345-0@lo:400:kworker.0 Request processed in 98us (16724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843205.977706:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788843205.978304:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795687296:0@lo:400:kworker.0 00000001:00100000:3.0:1788843205.986272:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fb38c5ab-0241-4970-81c2-7e93fb808128 00000001:00080000:3.0:1788843206.018547:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:1.0:1788843206.019158:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2359:x1875737775731584:12345-192.168.203.29@tcp:4:lfs.0 Request processed in 119208us (119782us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788843206.019178:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00002000:00100000:1.0:1788843206.019192:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8dab6e6bdf80 x1875737775731584/t4294967299(0) o4->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:576/0 lens 504/448 e 0 to 0 dl 1788843216 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788843206.019211:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab6e6bdf80 with x1875737775731584 ext(0->12) 00010000:00010000:1.0:1788843206.019223:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e7955cc1/0xc6b8ac1b0914ff5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084887 expref: 7 pid: 6692 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.019242:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e7955cc1/0xc6b8ac1b0914ff5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084887 expref: 7 pid: 6692 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788843206.019251:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8dab6e6bdf80 00000100:00100000:0.0:1788843206.022870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843206.024493:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775731712 00000100:00100000:3.0:1788843206.024571:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775731712 00010000:00010000:3.0:1788843206.024619:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e7955cc1/0xc6b8ac1b0914ff5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084887 expref: 7 pid: 6692 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843206.024654:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:3.0:1788843206.024664:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2356:x1875737775731712:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843206.024679:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788843206.024710:0:6708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788843206.024713:0:6708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788843205 00002000:00010000:3.0:1788843206.024716:0:6708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788843205 00002000:00010000:3.0:1788843206.024718:0:6708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788843205 00002000:00010000:3.0:1788843206.024720:0:6708:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1788843206.024726:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e7955cc1/0xc6b8ac1b0914ff5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084887 expref: 7 pid: 6692 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.024754:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e7955cc1/0xc6b8ac1b0914ff5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084887 expref: 7 pid: 6692 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.025191:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e7955cc1/0xc6b8ac1b0914ff5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084887 expref: 7 pid: 6692 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.025211:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843206.025216:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843206.025222:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073740507/0xc6b8ac1b0915042 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.025231:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073740507/0xc6b8ac1b0915042 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.025388:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843206.025520:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2356:x1875737775731712:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 855us (2657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843206.025531:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 36 00010000:00010000:1.0:1788843206.025837:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073740507/0xc6b8ac1b0915042 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.025849:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073740507/0xc6b8ac1b0915042 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.025881:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073740507/0xc6b8ac1b0915042 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.025888:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073740507/0xc6b8ac1b0915042 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.025896:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073740507/0xc6b8ac1b0915042 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.025903:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933bc00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843206.025909:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073740507/0xc6b8ac1b0915042 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.025930:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073740507/0xc6b8ac1b0915042 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.025943:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073740507/0xc6b8ac1b0915042 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.025949:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073740507/0xc6b8ac1b0915042 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843206.026182:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2358:x1875737775731456:12345-192.168.203.29@tcp:1:lfs.0 Request processed in 131920us (132080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843206.026192:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:0.0:1788843206.030108:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843206.030218:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775731968 00000100:00100000:1.0:1788843206.030228:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775731968 00000100:00100000:1.0:1788843206.030287:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:1.0:1788843206.030297:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+20:10304:x1875737775731968:12345-192.168.203.29@tcp:35:lfs.0 00000004:00010000:1.0:1788843206.030439:0:5850:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915034 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848a3 expref: 20 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788843206.030816:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1788843206.030873:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1788843206.031791:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1788843206.031877:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915049 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.031897:0:5850:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084879 expref: 24 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.031928:0:5850:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915049 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.031969:0:5850:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084879 expref: 24 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.031986:0:5850:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084879 expref: 24 pid: 5848 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843206.032001:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1875737795688064:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843206.032123:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab73b8ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843206.035252:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5850:1875737795688064:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843206.035290:0:5850:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915049 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843206.037135:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843206.037289:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775732096 00000100:00100000:3.0:1788843206.037301:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775732096 00010000:00010000:3.0:1788843206.037381:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084879 expref: 25 pid: 5848 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843206.037429:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:3.0:1788843206.037441:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+25:2359:x1875737775732096:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843206.037481:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843206.037490:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084879 expref: 25 pid: 5848 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.037510:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084879 expref: 25 pid: 5848 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.038052:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0914fd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084879 expref: 25 pid: 5848 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.038094:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:3.0:1788843206.038099:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915049 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.038109:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915049 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.038116:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915049 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.038148:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843206.038287:0:5850:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915049 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.038295:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915049 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788843206.038473:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1788843206.038723:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788843206.038838:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1875737795688192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788843206.038918:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843206.038956:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab73b8e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788843206.039268:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+26:2359:x1875737775732096:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 1825us (2138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843206.039280:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:0.0:1788843206.039401:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795688192 00000100:00100000:0.0:1788843206.039408:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795688192 00000100:00100000:0.0:1788843206.039452:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843206.039461:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1875737795688192:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788843206.039557:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1875737795688192:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 97us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843206.039564:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843206.039615:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1875737795688192:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788843206.040302:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1788843206.040419:0:5850:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc1c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1875737795688320:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788843206.040464:0:5850:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843206.040494:0:5850:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab46b77240 going to sleep for 11 seconds 00000100:00100000:0.0:1788843206.040514:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795688320 00000100:00100000:0.0:1788843206.040520:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795688320 00000100:00100000:0.0:1788843206.040546:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843206.040553:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5850:x1875737795688320:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788843206.040773:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5850:x1875737795688320:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 219us (307us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788843206.040781:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843206.040824:0:5850:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc1c000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5850:1875737795688320:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788843206.040872:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788843206.040909:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915049 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843206.040919:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915049 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843206.040934:0:5850:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915049 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843206.040941:0:5850:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933ac00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843206.040945:0:5850:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915049 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843206.040953:0:5850:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915049 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843206.040969:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:0.0:1788843206.040972:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788843206.040978:0:5850:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915049 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843206.040984:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915049 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788843206.041183:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788843206.041422:0:5850:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788843206.041433:0:5850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 330292090687ns, next at 331292088898ns, rc = 0 00000001:00080000:0.0:1788843206.041439:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788843206.041471:0:5850:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:0.0:1788843206.041475:0:5850:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788843206.041481:0:5850:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915034 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848a3 expref: 28 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843206.041578:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+27:10304:x1875737775731968:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 11282us (11482us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788843206.041597:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000020:00080000:0.0:1788843206.041602:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788843206.046779:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843206.047163:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775732224 00000100:00100000:1.0:1788843206.047188:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775732224 00000100:00100000:1.0:1788843206.047256:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:1.0:1788843206.047268:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+27:10304:x1875737775732224:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1788843206.047292:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843206.047314:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915050 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070848aa expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.047428:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915050 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848aa expref: 28 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.047443:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915050 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848aa expref: 28 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.047464:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:1.0:1788843206.047468:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843206.047471:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933bc00, rc 0) 00000100:00100000:1.0:1788843206.047680:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+28:10304:x1875737775732224:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 414us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843206.047688:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:2.0:1788843206.054575:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843206.055261:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775732480 00000100:00100000:3.0:1788843206.055273:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775732480 00000100:00100000:3.0:1788843206.055336:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:2.0:1788843206.055834:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6640f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+28:10304:x1875737775732480:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1788843206.056096:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6640f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+29:10304:x1875737775732480:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 524us (1533us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788843206.057882:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:3.0:1788843206.164526:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843206.165039:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775732736 00000100:00100000:2.0:1788843206.165049:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775732736 00000100:00100000:2.0:1788843206.165126:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:2.0:1788843206.165137:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+29:10313:x1875737775732736:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843206.165164:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843206.165188:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915057 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070848b1 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843206.165276:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788843206.165445:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915057 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848b1 expref: 31 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.165461:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43ece400) 00010000:00010000:2.0:1788843206.165464:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843206.165469:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915057 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848b1 expref: 31 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.165484:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88a00, rc 0) 00000100:00100000:2.0:1788843206.165545:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+30:10313:x1875737775732736:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 410us (1028us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788843206.165554:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:3.0:1788843206.174173:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843206.177563:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775732864 00000100:00100000:1.0:1788843206.177580:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775732864 00000100:00100000:1.0:1788843206.177662:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:1.0:1788843206.177683:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+30:10313:x1875737775732864:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:1.0:1788843206.177772:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915065 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.177791:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915065 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.177822:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915065 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.177840:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091506c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.177847:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091506c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.177853:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091506c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.177945:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915073 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.177954:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.177961:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843206.178001:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.178012:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915065 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.178020:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915065 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.178027:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915065 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.178944:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843206.178951:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915065 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.178961:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915065 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.178979:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:1.0:1788843206.178982:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843206.178988:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915065 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.178995:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915065 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.179024:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091506c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.179031:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091506c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.179037:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091506c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.179139:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843206.179143:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091506c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.179148:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091506c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.179172:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab61f39900) 00010000:00010000:1.0:1788843206.179174:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843206.179177:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091506c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.179183:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091506c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.179204:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.179211:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915073 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.179216:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915073 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.179221:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933ac00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843206.179224:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915073 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.179230:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915073 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.179237:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:1.0:1788843206.179240:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843206.179243:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915073 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.179248:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915073 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843206.179483:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+30:10313:x1875737775732864:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 1798us (5314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843206.179493:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:0.0:1788843206.182985:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843206.183146:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775733120 00000100:00100000:2.0:1788843206.183164:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775733120 00000100:00100000:2.0:1788843206.183260:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:2.0:1788843206.183301:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+30:10313:x1875737775733120:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1788843206.183728:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+31:10313:x1875737775733120:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 430us (762us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788843206.183738:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:3.0:1788843206.231640:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843206.231813:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775733376 00000100:00100000:2.0:1788843206.231827:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775733376 00000100:00100000:2.0:1788843206.231908:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:2.0:1788843206.231921:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+31:10317:x1875737775733376:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843206.231951:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843206.231979:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091507a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070848b8 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232096:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915081 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232117:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915081 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232134:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915081 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232153:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0915088 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232161:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0915088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232168:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0915088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232418:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091508f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232429:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091508f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232436:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091508f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843206.232449:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788843206.232596:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915081 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232605:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915081 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232613:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915081 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232620:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843206.232625:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915081 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232633:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915081 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232647:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:2.0:1788843206.232650:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843206.232656:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915081 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232663:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915081 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232687:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0915088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232692:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0915088 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232698:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0915088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232704:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff89e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843206.232707:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0915088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232713:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0915088 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232722:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab54910400) 00010000:00010000:2.0:1788843206.232724:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843206.232727:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0915088 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232732:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0915088 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232783:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091507a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848b8 expref: 34 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232798:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091508f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848b8 expref: 33 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.232817:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:2.0:1788843206.232819:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843206.232822:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88200, rc 0) 00000100:00100000:2.0:1788843206.232910:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+33:10317:x1875737775733376:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 991us (1296us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788843206.232919:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:0.0:1788843206.240835:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843206.240948:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775733504 00000100:00100000:3.0:1788843206.240961:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775733504 00000100:00100000:3.0:1788843206.241048:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:3.0:1788843206.241071:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+33:10317:x1875737775733504:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:3.0:1788843206.241163:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091509d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.241184:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091509d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.241198:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091509d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.241233:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091509d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.241240:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091509d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.241248:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091509d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.241255:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843206.241261:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091509d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.241269:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091509d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.241283:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:3.0:1788843206.241304:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843206.241310:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091509d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.241316:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091509d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843206.241599:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+33:10317:x1875737775733504:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 541us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843206.241608:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:0.0:1788843206.244898:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843206.245004:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775733760 00000100:00100000:2.0:1788843206.245017:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775733760 00000100:00100000:2.0:1788843206.245094:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:2.0:1788843206.245106:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+33:10317:x1875737775733760:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1788843206.245433:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+34:10317:x1875737775733760:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 328us (547us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1788843206.245441:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00010000:00010000:0.0:1788843206.406423:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843206.469259:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795688448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843206.469395:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843206.469736:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795688448 00000100:00100000:1.0:1788843206.469747:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795688448 00000100:00100000:1.0:1788843206.469822:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788843206.469834:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875737795688448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843206.469867:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1788843206.469936:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875737795688448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843206.469944:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788843206.470097:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795688448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843206.522121:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843206.522266:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775734016 00000100:00100000:2.0:1788843206.522279:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775734016 00000100:00100000:2.0:1788843206.522412:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:2.0:1788843206.522426:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+34:10348:x1875737775734016:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:2.0:1788843206.522461:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843206.522502:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b09150a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070848bf expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.522642:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09150ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.522662:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09150ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.522697:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09150ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843206.522713:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788843206.522923:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b09150a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848bf expref: 37 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.522948:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09150ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848bf expref: 36 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.522959:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:2.0:1788843206.522963:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843206.522967:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89e00, rc 0) 00000100:00100000:2.0:1788843206.523050:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+36:10348:x1875737775734016:12345-192.168.203.29@tcp:101:cat.0 Request processed in 626us (947us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788843206.523067:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:0.0:1788843206.527095:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843206.527299:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775734272 00000100:00100000:2.0:1788843206.527312:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775734272 00000100:00100000:2.0:1788843206.531674:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:2.0:1788843206.531717:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+36:10348:x1875737775734272:12345-192.168.203.29@tcp:35:cat.0 00000100:00100000:2.0:1788843206.532553:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+37:10348:x1875737775734272:12345-192.168.203.29@tcp:35:cat.0 Request processed in 855us (5467us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1788843206.532565:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:0.0:1788843206.535447:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843206.535575:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775734400 00000100:00100000:3.0:1788843206.535591:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775734400 00000100:00100000:3.0:1788843206.535697:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:3.0:1788843206.535712:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51551450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+37:2358:x1875737775734400:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843206.535735:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843206.535771:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09150ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848bf expref: 37 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.535796:0:7638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:3.0:1788843206.535803:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843206.535877:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51551450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+36:2358:x1875737775734400:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 169us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843206.535887:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:0.0:1788843206.581441:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843206.581556:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775734656 00000100:00100000:1.0:1788843206.581570:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775734656 00000100:00100000:1.0:1788843206.581662:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:1.0:1788843206.581675:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+36:10354:x1875737775734656:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:1.0:1788843206.581708:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843206.581712:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788843206.581749:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b0915011 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084895 expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.581774:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:1.0:1788843206.581781:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843206.581798:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b09150b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070848c6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.581942:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09150c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.581975:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091508f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848b8 expref: 36 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.581985:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09150c0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.582024:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091508f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848b8 expref: 36 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.582041:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091508f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848b8 expref: 36 pid: 7168 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843206.582068:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1875737795688576:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843206.582192:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab73b8ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843206.586490:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1875737795688576:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843206.586536:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09150c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843206.587870:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843206.588175:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775734784 00000100:00100000:3.0:1788843206.588201:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775734784 00010000:00010000:3.0:1788843206.588245:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091508f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848b8 expref: 37 pid: 7168 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843206.588289:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 38 00000100:00100000:3.0:1788843206.588299:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+37:2359:x1875737775734784:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843206.588317:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843206.588324:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091508f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848b8 expref: 37 pid: 7168 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.588338:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091508f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848b8 expref: 37 pid: 7168 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.588390:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091508f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848b8 expref: 37 pid: 7168 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.588411:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:3.0:1788843206.588417:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09150c0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.588428:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09150c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.588437:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09150c0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.588478:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843206.588549:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+36:2359:x1875737775734784:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 250us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843206.588567:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 38 00010000:00010000:2.0:1788843206.588729:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09150c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.588739:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09150c0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843206.588767:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788843206.588969:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b09150b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848c6 expref: 37 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.589001:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09150c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848c6 expref: 36 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.589009:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:2.0:1788843206.589013:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788843206.589016:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b400, rc 0) 00000100:00100000:2.0:1788843206.589044:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+36:10354:x1875737775734656:12345-192.168.203.29@tcp:101:dd.0 Request processed in 7373us (7618us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788843206.589062:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:0.0:1788843206.592942:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843206.593049:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775735040 00000100:00100000:2.0:1788843206.593072:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775735040 00000100:00100000:2.0:1788843206.593151:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:2.0:1788843206.593163:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+36:10354:x1875737775735040:12345-192.168.203.29@tcp:36:dd.0 00010000:00010000:2.0:1788843206.593571:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ce lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.593596:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843206.593610:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788843206.593674:0:7168:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788843206.593724:0:7168:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2cbaebc reply state 000000005a47a259 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843206.593735:0:7168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788843206.593851:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+39:10354:x1875737775735040:12345-192.168.203.29@tcp:36:dd.0 Request processed in 689us (921us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788843206.593859:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 52 00000020:00080000:2.0:1788843206.593864:0:7168:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788843206.595644:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.595664:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.595673:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.595679:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843206.595684:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.595692:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.595714:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:3.0:1788843206.595718:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843206.595724:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ce lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.595731:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ce lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843206.880711:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843206.880803:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775735168 00000100:00100000:3.0:1788843206.880825:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775735168 00000100:00100000:3.0:1788843206.880933:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:3.0:1788843206.880949:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+38:10368:x1875737775735168:12345-192.168.203.29@tcp:101:stat.0 00010000:00010000:3.0:1788843206.880996:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843206.881640:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09150d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070848cd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.881737:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09150dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.881756:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09150dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.881882:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09150dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.881903:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09150e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.881912:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09150e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.881919:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09150e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.882429:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09150ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.882447:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09150c0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848c6 expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.882457:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09150ea lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.882509:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09150c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848c6 expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.883744:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09150c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848c6 expref: 39 pid: 5848 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843206.884127:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e8e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795688704:192.168.203.29@tcp:104: 00000100:00100000:3.0:1788843206.884391:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4936a480 going to sleep for 11 seconds 00000100:00100000:0.0:1788843206.894607:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843206.894764:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e8e1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795688704:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843206.894793:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09150ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843206.896399:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775735424 00000100:00100000:2.0:1788843206.896423:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775735424 00000100:00100000:2.0:1788843206.896534:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:2.0:1788843206.896548:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+40:9957:x1875737775735424:12345-192.168.203.29@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788843206.897266:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+41:9957:x1875737775735424:12345-192.168.203.29@tcp:35:ldlm_bl.0 Request processed in 714us (2662us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788843206.897278:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:0.0:1788843206.904290:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843206.904509:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775735552 00000100:00100000:3.0:1788843206.904519:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775735552 00010000:00010000:3.0:1788843206.904562:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09150c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848c6 expref: 41 pid: 5848 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843206.904643:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:3.0:1788843206.904665:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+41:2359:x1875737775735552:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843206.904682:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843206.904690:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09150c0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848c6 expref: 41 pid: 5848 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.904705:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09150c0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848c6 expref: 41 pid: 5848 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.904729:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09150c0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848c6 expref: 41 pid: 5848 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.904777:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:3.0:1788843206.904782:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09150ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.904792:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09150ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.904800:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09150ea lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843206.904881:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843206.904947:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+40:2359:x1875737775735552:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 295us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843206.904954:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 39 00010000:00010000:1.0:1788843206.905232:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09150ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905242:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09150ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843206.905289:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788843206.905293:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788843206.905333:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09150ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905374:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09150ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905385:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09150dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905392:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09150dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905399:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09150dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905405:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843206.905410:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09150dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905417:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09150dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905428:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:1.0:1788843206.905431:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843206.905435:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09150dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905441:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09150dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905455:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09150e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905461:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09150e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905478:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09150e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905483:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843206.905486:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09150e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905492:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09150e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905500:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab43e63500) 00010000:00010000:1.0:1788843206.905503:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843206.905506:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09150e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905511:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09150e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905548:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09150d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848cd expref: 40 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905563:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09150ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848cd expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843206.905571:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:1.0:1788843206.905573:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843206.905576:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82054e00, rc 0) 00000100:00100000:1.0:1788843206.905621:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+39:10368:x1875737775735168:12345-192.168.203.29@tcp:101:stat.0 Request processed in 24675us (24922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843206.905636:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:0.0:1788843207.025987:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843207.027486:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775735808 00000100:00100000:2.0:1788843207.027509:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775735808 00000100:00100000:2.0:1788843207.027638:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:2.0:1788843207.027656:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+39:10374:x1875737775735808:12345-192.168.203.29@tcp:36:truncate.0 00010000:00010000:2.0:1788843207.027742:0:7168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843207.027784:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09150ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848cd expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.027817:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:2.0:1788843207.027823:0:7168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843207.028160:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09150f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.028202:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09150f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.028214:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09150f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788843207.028283:0:7168:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788843207.028312:0:7168:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b1777d93 reply state 0000000099e18da4 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09150f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843207.028322:0:7168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788843207.028559:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+41:10374:x1875737775735808:12345-192.168.203.29@tcp:36:truncate.0 Request processed in 909us (2587us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788843207.028568:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 54 00000020:00080000:2.0:1788843207.028575:0:7168:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1788843207.029385:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788843207.035283:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09150f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.035308:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09150f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.035319:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09150f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.035326:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff89800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843207.035333:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09150f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.035369:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09150f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.035427:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:2.0:1788843207.035431:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843207.035438:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09150f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.035446:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09150f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843207.124540:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843207.124662:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775735936 00000100:00100000:2.0:1788843207.124676:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775735936 00000100:00100000:2.0:1788843207.124755:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:2.0:1788843207.124766:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+40:10388:x1875737775735936:12345-192.168.203.29@tcp:101:stat.0 00010000:00010000:2.0:1788843207.124869:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843207.124904:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09150f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070848d4 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.125106:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.125126:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.125140:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.125156:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915106 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.125162:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.125190:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.125316:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b091510d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.125323:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b091510d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.125330:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b091510d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843207.126153:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1788843207.126165:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843207.126199:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b091510d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.126215:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b091510d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.126225:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.126232:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.126240:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.126245:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843207.126249:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.126268:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.126284:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:2.0:1788843207.126287:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843207.126292:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.126298:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09150ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.126314:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.126319:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915106 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.126325:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.126330:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843207.126332:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.126337:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915106 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.126389:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab54910400) 00010000:00010000:2.0:1788843207.126391:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843207.126394:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915106 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.126408:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915106 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.126455:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09150f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848d4 expref: 42 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.126469:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b091510d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848d4 expref: 41 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.126478:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:2.0:1788843207.126480:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843207.126483:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88000, rc 0) 00000100:00100000:2.0:1788843207.126576:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+41:10388:x1875737775735936:12345-192.168.203.29@tcp:101:stat.0 Request processed in 1810us (2049us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843207.126585:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:0.0:1788843207.253278:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843207.255673:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775736192 00000100:00100000:2.0:1788843207.255694:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775736192 00000100:00100000:2.0:1788843207.255815:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:2.0:1788843207.255828:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+41:10398:x1875737775736192:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843207.255857:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843207.255888:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915114 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070848db expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843207.256012:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788843207.256246:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915114 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848db expref: 43 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.256288:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43ece400) 00010000:00010000:2.0:1788843207.256292:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843207.256299:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915114 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848db expref: 43 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.256316:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89800, rc 0) 00000100:00100000:2.0:1788843207.256735:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+42:10398:x1875737775736192:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 908us (3472us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788843207.256745:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:3.0:1788843207.259578:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843207.259691:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775736448 00000100:00100000:2.0:1788843207.259704:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775736448 00000100:00100000:2.0:1788843207.259849:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:2.0:1788843207.259867:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+42:10398:x1875737775736448:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1788843207.260382:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+43:10398:x1875737775736448:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 516us (815us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788843207.260392:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:0.0:1788843207.336459:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843207.336902:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775736704 00000100:00100000:1.0:1788843207.336915:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775736704 00000100:00100000:1.0:1788843207.337077:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:1.0:1788843207.337091:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+43:10404:x1875737775736704:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:1.0:1788843207.337124:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843207.337158:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915122 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070848e2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.337308:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915129 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.337326:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b091510d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848d4 expref: 44 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.337335:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915129 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.337417:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b091510d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848d4 expref: 44 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.337434:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b091510d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848d4 expref: 44 pid: 5848 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843207.337450:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795688832:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843207.337604:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab73b8e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843207.343435:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795688832:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843207.343515:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915129 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843207.353108:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843207.353539:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775736832 00000100:00100000:1.0:1788843207.353554:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775736832 00010000:00010000:1.0:1788843207.353625:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b091510d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848d4 expref: 45 pid: 5848 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843207.353685:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:1.0:1788843207.353698:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+45:2358:x1875737775736832:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843207.353721:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843207.353730:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b091510d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848d4 expref: 45 pid: 5848 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.353749:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b091510d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848d4 expref: 45 pid: 5848 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.353785:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b091510d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848d4 expref: 45 pid: 5848 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.353812:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:1.0:1788843207.353819:0:6708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915129 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.353833:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915129 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.353853:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915129 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.353930:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843207.354016:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+44:2358:x1875737775736832:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 320us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843207.354025:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 40 00010000:00010000:2.0:1788843207.354710:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915129 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.354724:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915129 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843207.354749:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788843207.354981:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915122 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848e2 expref: 45 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.355043:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915129 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848e2 expref: 44 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.355065:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:2.0:1788843207.355068:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788843207.355072:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933ae00, rc 0) 00000100:00100000:2.0:1788843207.355126:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+44:10404:x1875737775736704:12345-192.168.203.29@tcp:101:bash.0 Request processed in 18038us (18684us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788843207.355135:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:0.0:1788843207.368312:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843207.370949:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775737088 00000100:00100000:2.0:1788843207.370971:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775737088 00000100:00100000:2.0:1788843207.371079:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00100000:2.0:1788843207.371093:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+44:10404:x1875737775737088:12345-192.168.203.29@tcp:36:bash.0 00010000:00010000:2.0:1788843207.372037:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915137 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.372071:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.372086:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788843207.372153:0:7168:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1788843207.372186:0:7168:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9af5fc0 reply state 0000000061870d44 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843207.372197:0:7168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788843207.373817:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+47:10404:x1875737775737088:12345-192.168.203.29@tcp:36:bash.0 Request processed in 2718us (5514us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788843207.373829:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 58 00000020:00080000:2.0:1788843207.373837:0:7168:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788843207.377151:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915137 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.377186:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915137 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.377196:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915137 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.377211:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff89800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843207.377217:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915137 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.377226:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915137 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.377274:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:3.0:1788843207.377277:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843207.377283:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915137 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.377290:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915137 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843207.381315:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843207.382077:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775737216 00000100:00100000:2.0:1788843207.382093:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775737216 00000100:00100000:2.0:1788843207.382201:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:2.0:1788843207.382216:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+46:10404:x1875737775737216:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1788843207.382255:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843207.382289:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091513e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070848e9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.382700:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.382720:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915129 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848e2 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.382730:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915145 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.382776:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915129 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848e2 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.382792:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915129 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848e2 expref: 47 pid: 5846 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843207.382809:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1875737795688960:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843207.382940:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6e76b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843207.386054:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843207.386787:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775737344 00000100:00100000:3.0:1788843207.386803:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775737344 00010000:00010000:3.0:1788843207.386861:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915129 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848e2 expref: 48 pid: 5846 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843207.386904:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:3.0:1788843207.386915:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+48:2359:x1875737775737344:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843207.386946:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843207.386956:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915129 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848e2 expref: 48 pid: 5846 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.386971:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915129 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848e2 expref: 48 pid: 5846 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.387002:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:3.0:1788843207.387008:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915145 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.387020:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.387060:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915145 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.387087:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843207.387175:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+48:2359:x1875737775737344:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 261us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843207.387184:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 41 00010000:00010000:2.0:1788843207.387516:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915129 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070848e2 expref: 47 pid: 5846 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843207.387556:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1875737795688960:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843207.387596:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.387607:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.387613:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843207.387673:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788843207.387678:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843207.387705:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915145 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.387747:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091513e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848e9 expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.387768:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915145 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848e9 expref: 46 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.387777:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:2.0:1788843207.387781:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843207.387785:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88e00, rc 0) 00000100:00100000:2.0:1788843207.387846:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+46:10404:x1875737775737216:12345-192.168.203.29@tcp:101:bash.0 Request processed in 5633us (6549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843207.387855:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:0.0:1788843207.397175:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843207.397534:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775737600 00000100:00100000:3.0:1788843207.397550:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775737600 00000100:00100000:3.0:1788843207.397641:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:3.0:1788843207.397654:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6640cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+46:10404:x1875737775737600:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:3.0:1788843207.398088:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6640cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+47:10404:x1875737775737600:12345-192.168.203.29@tcp:35:bash.0 Request processed in 434us (931us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788843207.398097:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00010000:00010000:3.0:1788843207.428619:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843207.483275:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843207.483382:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775737856 00000100:00100000:3.0:1788843207.483396:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775737856 00000100:00100000:3.0:1788843207.483544:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:3.0:1788843207.483557:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+47:10414:x1875737775737856:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843207.483595:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843207.483746:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b091514c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070848f0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843207.483881:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788843207.484056:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b091514c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848f0 expref: 49 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.484099:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43ece400) 00010000:00010000:3.0:1788843207.484103:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843207.484111:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b091514c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848f0 expref: 49 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.484132:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82054e00, rc 0) 00000100:00100000:3.0:1788843207.484471:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+48:10414:x1875737775737856:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 915us (1210us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788843207.484481:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:0.0:1788843207.488275:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843207.494148:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775737984 00000100:00100000:1.0:1788843207.494173:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775737984 00000100:00100000:1.0:1788843207.494298:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:1.0:1788843207.494311:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+48:10414:x1875737775737984:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:1.0:1788843207.494432:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091515a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.494454:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091515a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.494595:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091515a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.494624:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915161 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.494633:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.494640:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.494757:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915168 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.494790:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.494798:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843207.494971:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.494988:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091515a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.494996:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091515a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495004:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091515a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495011:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843207.495016:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091515a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495025:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091515a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495040:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:1.0:1788843207.495043:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843207.495058:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091515a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495066:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091515a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495109:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495117:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915161 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495123:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495127:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843207.495131:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495138:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915161 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495146:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab61f39900) 00010000:00010000:1.0:1788843207.495149:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843207.495151:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915161 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495156:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915161 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495174:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495180:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915168 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495187:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915168 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495197:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933ae00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843207.495201:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915168 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495208:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915168 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495216:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:1.0:1788843207.495218:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843207.495222:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915168 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843207.495227:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915168 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843207.495421:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+48:10414:x1875737775737984:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 1109us (7158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843207.495431:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:0.0:1788843207.499007:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843207.499158:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775738240 00000100:00100000:2.0:1788843207.499172:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775738240 00000100:00100000:2.0:1788843207.499282:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:2.0:1788843207.499296:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+48:10414:x1875737775738240:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1788843207.500164:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+49:10414:x1875737775738240:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 864us (1173us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788843207.500176:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:2.0:1788843207.539280:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843207.539709:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775738496 00000100:00100000:3.0:1788843207.539722:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775738496 00000100:00100000:3.0:1788843207.539811:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:3.0:1788843207.539824:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+49:10417:x1875737775738496:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843207.539866:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843207.539893:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b091516f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070848f7 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540024:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915176 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540042:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915176 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540065:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915176 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540083:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091517d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540100:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091517d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540107:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091517d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540260:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0915184 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540270:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0915184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540276:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0915184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843207.540287:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788843207.540473:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915176 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540481:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915176 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540488:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915176 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540495:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843207.540500:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915176 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540508:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915176 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540534:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:3.0:1788843207.540537:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843207.540542:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915176 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540548:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915176 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540567:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091517d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540573:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091517d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540578:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091517d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540583:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843207.540586:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091517d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540592:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091517d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540599:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab43e63c00) 00010000:00010000:3.0:1788843207.540601:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843207.540604:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091517d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540610:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091517d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540673:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b091516f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848f7 expref: 52 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540692:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0915184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848f7 expref: 51 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.540700:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:3.0:1788843207.540703:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843207.540705:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82055800, rc 0) 00000100:00100000:3.0:1788843207.540791:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+51:10417:x1875737775738496:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 969us (1528us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788843207.540800:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:0.0:1788843207.545917:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843207.545978:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843207.546194:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775738752 00000100:00100000:3.0:1788843207.546207:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775738752 00000100:00100000:3.0:1788843207.546293:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:3.0:1788843207.546308:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+51:2357:x1875737775738752:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843207.546329:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843207.546394:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0915184 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848f7 expref: 51 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.546426:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:3.0:1788843207.546433:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843207.546510:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+50:2357:x1875737775738752:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 205us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843207.546518:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:2.0:1788843207.546666:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775738624 00000100:00100000:2.0:1788843207.546670:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775738624 00000100:00100000:2.0:1788843207.546723:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:2.0:1788843207.546731:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+50:10417:x1875737775738624:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:2.0:1788843207.546803:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915192 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.546821:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.546833:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.546878:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.546885:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915192 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.546891:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.546910:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843207.546915:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.546922:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915192 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.546930:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:2.0:1788843207.546933:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843207.546937:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915192 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.546942:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915192 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843207.546985:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+50:10417:x1875737775738624:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 255us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843207.546992:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:0.0:1788843207.549571:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843207.549674:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775739008 00000100:00100000:3.0:1788843207.549687:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775739008 00000100:00100000:3.0:1788843207.549758:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:3.0:1788843207.549769:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+50:10417:x1875737775739008:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:3.0:1788843207.550183:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+51:10417:x1875737775739008:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 413us (623us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788843207.550192:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:0.0:1788843207.697324:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843207.697504:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775739264 00000100:00100000:3.0:1788843207.697517:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775739264 00000100:00100000:3.0:1788843207.697803:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:3.0:1788843207.697821:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+51:10435:x1875737775739264:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:3.0:1788843207.697871:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843207.697904:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0915199 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070848fe expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.698067:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09151a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.698087:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09151a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.698102:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09151a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843207.698118:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788843207.698306:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b0915199 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848fe expref: 54 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.698335:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09151a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848fe expref: 53 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.698433:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:3.0:1788843207.698437:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788843207.698442:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82054e00, rc 0) 00000100:00100000:3.0:1788843207.698529:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+53:10435:x1875737775739264:12345-192.168.203.29@tcp:101:cat.0 Request processed in 712us (1221us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788843207.699893:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:0.0:1788843207.735670:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843207.735873:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775739392 00000100:00100000:2.0:1788843207.735889:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775739392 00000100:00100000:2.0:1788843207.735981:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00100000:2.0:1788843207.735995:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+53:10436:x1875737775739392:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843207.736031:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843207.736073:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b09151ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084905 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.736173:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09151b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.736215:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09151b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.736230:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09151b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843207.736277:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788843207.736282:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843207.736305:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09151b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.736335:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b09151ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084905 expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.736398:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09151b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084905 expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.736407:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:2.0:1788843207.736411:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843207.736415:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89e00, rc 0) 00000100:00100000:2.0:1788843207.736695:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+54:10436:x1875737775739392:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 701us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843207.736705:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00100000:1.0:1788843207.743139:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843207.743237:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775739776 00000100:00100000:2.0:1788843207.743252:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775739776 00000100:00100000:2.0:1788843207.743324:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:2.0:1788843207.743337:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+54:10436:x1875737775739776:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1788843207.744007:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+55:10436:x1875737775739776:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 670us (880us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788843207.744036:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:0.0:1788843207.747098:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843207.747206:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775739904 00000100:00100000:3.0:1788843207.747218:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775739904 00000100:00100000:3.0:1788843207.747310:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:3.0:1788843207.747324:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+55:10436:x1875737775739904:12345-192.168.203.29@tcp:103:lfs.0 00010000:00010000:3.0:1788843207.747388:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788843207.747423:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915145 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848e9 expref: 55 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.747451:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09151a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848fe expref: 54 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.747479:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915050 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070848aa expref: 53 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.747507:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:3.0:1788843207.747521:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843207.747589:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+52:10436:x1875737775739904:12345-192.168.203.29@tcp:103:lfs.0 Request processed in 268us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843207.747600:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:0.0:1788843207.750302:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843207.750465:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775740032 00000100:00100000:3.0:1788843207.750479:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775740032 00000100:00100000:3.0:1788843207.750562:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:3.0:1788843207.750574:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+52:10436:x1875737775740032:12345-192.168.203.29@tcp:58:lfs.0 00010000:00010000:3.0:1788843207.750749:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09151bc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.750769:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09151bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843207.750785:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09151bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788843207.751154:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843207.751412:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788843207.751492:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788843207.751619:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+52:10436:x1875737775740032:12345-192.168.203.29@tcp:58:lfs.0 Request processed in 1043us (1327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843207.751631:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:0.0:1788843207.777334:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843207.777875:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775740160 00000100:00100000:2.0:1788843207.777892:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775740160 00000100:00100000:2.0:1788843207.777987:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 67 00000100:00100000:2.0:1788843207.778001:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+52:10438:x1875737775740160:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843207.778030:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843207.778068:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b09151c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c60708490c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778161:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09151ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778181:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09151ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778195:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09151ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778213:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09151d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778221:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09151d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778228:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09151d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778382:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09151d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778417:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09151d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778425:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09151d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843207.778765:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788843207.778771:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843207.778796:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09151d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778812:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09151d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778823:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09151ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778831:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09151ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778850:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09151ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778858:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843207.778864:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09151ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778872:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09151ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778887:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:2.0:1788843207.778891:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843207.778905:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09151ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778912:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09151ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778929:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09151d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778936:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09151d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778943:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09151d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778949:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843207.778952:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09151d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778960:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09151d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778968:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab54910400) 00010000:00010000:2.0:1788843207.778971:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843207.778974:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09151d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.778981:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09151d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.779023:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b09151c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708490c expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.779070:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09151d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708490c expref: 53 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843207.779080:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63c00) 00010000:00010000:2.0:1788843207.779083:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843207.779086:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89800, rc 0) 00000100:00100000:2.0:1788843207.779186:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+53:10438:x1875737775740160:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1188us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843207.779196:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 67 00000001:00080000:3.0:1788843208.063779:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967325 is committed 00000004:00080000:3.0:1788843208.063794:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788843208.063823:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dab46b77cc0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788843208.063829:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dab43640a00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dab46b770c0 00000020:00080000:3.0:1788843208.063833:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dab43640500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dab7fc47400 00000020:00080000:3.0:1788843208.063858:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788843208.064023:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1788843208.064362:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843208.064392:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab600bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795689088:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788843208.064542:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843208.064662:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795689088 00000100:00100000:1.0:1788843208.064672:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795689088 00000100:00100000:1.0:1788843208.064745:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788843208.064756:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875737795689088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788843208.064789:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788843208.064829:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f94c5, atime: 0x6a9f94c5, ctime: 0x6a9f94c5, blocks: 0xb 00010000:00010000:1.0:1788843208.064838:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b09151df lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.064884:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1788843208.064889:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843208.064898:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b09151df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.064917:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b09151df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.064929:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b09151df lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.064939:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b09151df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.064960:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1788843208.065564:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843208.066063:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3306:x1875737795689088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1305us (1518us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788843208.066074:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788843208.066110:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843208.066119:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b09151df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.066131:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843208.066137:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b09151df lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.066163:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b09151df lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.066185:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b09151df lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.066194:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061b4d2e2/0xc6b8ac1b09151df lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.066216:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843208.066218:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843208.066220:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788843208.066658:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:0.0:1788843208.067012:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dab600bdc00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788843208.067023:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab600bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795689088:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788843208.452992:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788843208.518200:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788843208.518221:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788843208.521285:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788843208.521306:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788843208.521524:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e8e1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875737795689216:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788843208.522154:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab48baecc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843208.532767:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e8e1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875737795689216:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788843208.536756:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843208.536846:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775740288 00000100:00100000:3.0:1788843208.536862:0:5858:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775740288 00000100:00100000:3.0:1788843208.536939:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:3.0:1788843208.536953:0:5858:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fb38c5ab-0241-4970-81c2-7e93fb808128+11:10449:x1875737775740288:12345-192.168.203.29@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788843208.537092:0:5858:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:fb38c5ab-0241-4970-81c2-7e93fb808128+11:10449:x1875737775740288:12345-192.168.203.29@tcp:900:lhsmtool_posix.0 Request processed in 141us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843208.537101:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:0.0:1788843208.540874:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843208.540920:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775740416 00000100:00100000:0.0:1788843208.540933:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775740416 00000100:00100000:0.0:1788843208.541022:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 68 00000100:00100000:0.0:1788843208.541034:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+11:10449:x1875737775740416:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788843208.541092:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788843208.541249:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+11:10449:x1875737775740416:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 217us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843208.541258:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 68 00000100:00100000:0.0:1788843208.548451:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843208.551261:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775740544 00000100:00100000:1.0:1788843208.551282:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775740544 00000100:00100000:1.0:1788843208.551386:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:1.0:1788843208.551401:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+11:10449:x1875737775740544:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788843208.551506:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b09151e6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551526:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b09151e6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551677:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b09151e6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551698:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b09151ed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551718:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b09151ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551725:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b09151ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551757:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b09151f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551766:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b09151f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551772:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b09151f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843208.551823:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788843208.551828:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788843208.551844:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b09151f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551857:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b09151e6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551865:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b09151e6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551873:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b09151e6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551880:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843208.551887:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b09151e6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551900:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b09151e6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551916:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab61f39d00) 00010000:00010000:1.0:1788843208.551919:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843208.551926:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b09151e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551934:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b09151e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551962:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b09151ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551969:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b09151ed lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551975:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b09151ed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551980:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933a000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843208.551982:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b09151ed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551987:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b09151ed lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.551994:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8dab61f39000) 00010000:00010000:1.0:1788843208.551997:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843208.551999:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b09151ed lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.552013:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b09151ed lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.552034:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b09151f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.552053:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b09151f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.552059:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b09151f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.552065:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933be00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843208.552068:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b09151f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.552073:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b09151f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.552081:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63c00) 00010000:00010000:1.0:1788843208.552083:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843208.552086:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b09151f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.552091:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b09151f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843208.552258:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+11:10449:x1875737775740544:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 Request processed in 856us (3821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843208.552267:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:2.0:1788843208.563805:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843208.564245:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775740800 00000100:00100000:3.0:1788843208.564260:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775740800 00000100:00100000:3.0:1788843208.564374:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 70 00000100:00100000:3.0:1788843208.564386:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+11:10449:x1875737775740800:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843208.564414:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843208.564444:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09151fb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084913 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.564765:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0915202 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.564787:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0915202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.564802:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0915202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843208.564815:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788843208.565151:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0915202 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.565163:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0915202 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.565171:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0915202 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.565179:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843208.565184:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0915202 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.565193:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0915202 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.565210:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63c00) 00010000:00010000:3.0:1788843208.565214:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843208.565219:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0915202 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.565226:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0915202 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.565278:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09151fb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084913 expref: 13 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.565291:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab61f39d00) 00010000:00010000:3.0:1788843208.565293:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843208.565297:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09151fb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084913 expref: 13 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.565323:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82054e00, rc 0) 00000100:00100000:3.0:1788843208.565449:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+12:10449:x1875737775740800:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 1064us (1657us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788843208.565472:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 70 00000100:00100000:3.0:1788843208.570998:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843208.571065:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775740928 00000100:00100000:3.0:1788843208.571078:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775740928 00000100:00100000:3.0:1788843208.571154:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 71 00000100:00100000:3.0:1788843208.571170:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+12:10449:x1875737775740928:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788843208.571227:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788843208.571415:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+12:10449:x1875737775740928:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 248us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843208.571425:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 71 00000100:00100000:0.0:1788843208.578819:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843208.579165:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775741184 00000100:00100000:3.0:1788843208.579181:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775741184 00000100:00100000:3.0:1788843208.579269:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 72 00000100:00100000:3.0:1788843208.579281:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+12:10449:x1875737775741184:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843208.579311:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843208.579315:0:7168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788843208.579903:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09151b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084905 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.579927:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:3.0:1788843208.579933:0:7168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843208.579961:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915210 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c60708491a expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788843208.581063:0:7168:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788843208.581469:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0915217 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.581488:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0915217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.581501:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0915217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.581577:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915210 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708491a expref: 14 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.581599:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0915217 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708491a expref: 13 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.581609:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:3.0:1788843208.581612:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843208.581616:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41532a00, rc 0) 00000100:00100000:3.0:1788843208.581779:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43783b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+13:10449:x1875737775741184:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 2498us (2972us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788843208.581789:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 72 00000100:00100000:2.0:1788843208.588730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843208.588879:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775741440 00000100:00100000:3.0:1788843208.588894:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775741440 00000100:00100000:3.0:1788843208.588978:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 73 00000100:00100000:3.0:1788843208.588992:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+13:10449:x1875737775741440:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788843208.589093:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843208.589131:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0915217 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708491a expref: 13 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.589153:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:3.0:1788843208.589167:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843208.589195:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0915225 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.589214:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0915225 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.589225:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0915225 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.589243:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091522c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xff989bf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.589250:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091522c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xff989bf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.589257:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091522c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xff989bf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.589591:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0915225 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.589840:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0915225 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.590074:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0915225 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.590087:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41532e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843208.590093:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0915225 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.590102:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0915225 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.590114:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:3.0:1788843208.590118:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843208.590124:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0915225 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.590131:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b0915225 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.590143:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091522c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xff989bf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.590150:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091522c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xff989bf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.590156:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091522c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xff989bf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.590161:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843208.590164:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091522c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xff989bf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.590170:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091522c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xff989bf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.590190:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xff989bf1 (ffff8dab43e63b00) 00010000:00010000:3.0:1788843208.590192:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843208.590196:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091522c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xff989bf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.590202:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b091522c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xff989bf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843208.590430:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+12:10449:x1875737775741440:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 1340us (1615us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788843208.590442:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 73 00000100:00100000:0.0:1788843208.595186:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843208.595432:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775741568 00000100:00100000:1.0:1788843208.595446:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775741568 00000100:00100000:1.0:1788843208.595533:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 74 00000100:00100000:1.0:1788843208.595546:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+12:10449:x1875737775741568:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788843208.595574:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843208.595603:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915233 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084921 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.595669:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091523a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.595689:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091523a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.595703:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091523a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.595834:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915233 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084921 expref: 14 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.595890:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091523a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084921 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.595901:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dab61f39000) 00010000:00010000:1.0:1788843208.595905:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788843208.595909:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b000, rc 0) 00000100:00100000:1.0:1788843208.595999:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+13:10449:x1875737775741568:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 457us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843208.596008:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 74 00000100:00100000:1.0:1788843208.609016:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843208.609100:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775741824 00000100:00100000:3.0:1788843208.609116:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775741824 00000100:00100000:3.0:1788843208.609209:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 75 00000100:00100000:3.0:1788843208.609223:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+13:10449:x1875737775741824:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788843208.609363:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915241 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.609386:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915241 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.609400:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915241 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788843208.610080:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1788843208.610098:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 332860755182ns, next at 333860751127ns, rc = 0 00000004:00010000:3.0:1788843208.610226:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000480c9485 reply state 000000007b6c82f5 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915241 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843208.610257:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788843208.610430:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+15:10449:x1875737775741824:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 1208us (1423us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788843208.610441:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 75 00000100:00100000:0.0:1788843208.613315:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00010000:00010000:1.0:1788843208.613651:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915241 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.613665:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915241 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.613673:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915241 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.613680:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843208.613686:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915241 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.613695:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915241 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.613716:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dab61f39000) 00010000:00010000:1.0:1788843208.613720:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788843208.613726:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915241 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.613733:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915241 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843208.613813:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775741952 00000100:00100000:3.0:1788843208.613828:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775741952 00000100:00100000:3.0:1788843208.614017:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 76 00000100:00100000:3.0:1788843208.614032:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+14:10449:x1875737775741952:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843208.614074:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843208.614099:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0915248 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084928 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.614176:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0915248 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084928 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.614190:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0915248 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084928 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.614211:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dab61f39000) 00010000:00010000:3.0:1788843208.614214:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843208.614217:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82054e00, rc 0) 00000100:00100000:3.0:1788843208.614305:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+15:10449:x1875737775741952:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 277us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843208.614313:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 76 00000100:00100000:0.0:1788843208.620789:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843208.620953:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775742080 00000100:00100000:3.0:1788843208.620966:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775742080 00000100:00100000:3.0:1788843208.621218:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:3.0:1788843208.621229:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1875737775742080:12345-192.168.203.29@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788843208.621274:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp t0 exp 0000000000000000 cur 332 last 0 00000020:00000080:3.0:1788843208.621319:0:6693:0:(genops.c:1385:class_connect()) connect: client fb38c5ab-0241-4970-81c2-7e93fb808128, cookie 0xc6b8ac1b091524f 00002000:00100000:3.0:1788843208.621372:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fb38c5ab-0241-4970-81c2-7e93fb808128/ffff8dab60259800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788843208.621410:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788843208.621727:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788843208.621770:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8dab6025f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788843208.622050:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2355:x1875737775742080:12345-192.168.203.29@tcp:8:lhsmtool_posix.0 Request processed in 810us (1266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843208.622062:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:1.0:1788843208.624259:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843208.625009:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775742208 00000100:00100000:0.0:1788843208.625023:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775742208 00000100:00100000:0.0:1788843208.625378:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:0.0:1788843208.625392:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:0:x1875737775742208:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788843208.626188:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788843208.638570:0:12002:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788843208.638584:0:12002:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788843208.638634:0:12002:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788843208.638642:0:12002:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:0.0:1788843208.669048:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1788843208.669073:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fb38c5ab-0241-4970-81c2-7e93fb808128 00000100:00100000:3.0:1788843208.669197:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+5:0:x1875737775742208:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 43801us (44944us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788843208.669210:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:0.0:1788843208.674372:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843208.674708:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775742464 00000100:00100000:3.0:1788843208.674721:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775742464 00000100:00100000:3.0:1788843208.674822:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:3.0:1788843208.674835:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+15:10449:x1875737775742464:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788843208.675162:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43783480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+16:10449:x1875737775742464:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 327us (828us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788843208.675184:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:0.0:1788843208.677322:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843208.677443:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775742720 00000100:00100000:1.0:1788843208.677465:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775742720 00000100:00100000:1.0:1788843208.677555:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 77 00000100:00100000:1.0:1788843208.677567:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+16:10449:x1875737775742720:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788843208.677698:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+16:10449:x1875737775742720:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 134us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843208.677715:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 77 00000100:00100000:0.0:1788843208.679892:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843208.680047:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775742848 00000100:00100000:2.0:1788843208.680059:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775742848 00000100:00100000:2.0:1788843208.680142:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 78 00000100:00100000:2.0:1788843208.680156:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+16:10449:x1875737775742848:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843208.680189:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843208.680221:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915256 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c60708492f expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.680318:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091525d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.680383:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091525d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.680418:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091525d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843208.680479:0:7168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843208.680514:0:7168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091525d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.680547:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915256 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708492f expref: 18 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.680567:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091525d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708492f expref: 17 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.680577:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dab61f39000) 00010000:00010000:2.0:1788843208.680580:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788843208.680585:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88200, rc 0) 00000100:00100000:2.0:1788843208.680746:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+17:10449:x1875737775742848:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 592us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843208.680754:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 78 00000100:00100000:0.0:1788843208.686451:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843208.688101:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775742976 00000100:00100000:1.0:1788843208.688115:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775742976 00000100:00100000:1.0:1788843208.688183:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:1.0:1788843208.688196:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2356:x1875737775742976:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788843208.688220:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843208.688246:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915264 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084936 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788843208.688279:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f94c8, blocks: 0x1 00010000:00010000:1.0:1788843208.688305:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1788843208.688310:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843208.688321:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915264 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084936 expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.688363:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915264 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084936 expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.688379:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b400, rc 0) 00000100:00100000:1.0:1788843208.688462:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2356:x1875737775742976:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 257us (2015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843208.688470:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:1.0:1788843208.691618:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843208.691697:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775743232 00000100:00100000:0.0:1788843208.691710:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775743232 00000100:00100000:0.0:1788843208.692207:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 79 00000100:00100000:0.0:1788843208.692222:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+17:10449:x1875737775743232:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788843208.692393:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51455f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+17:10449:x1875737775743232:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 173us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843208.692401:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 79 00000100:00100000:0.0:1788843208.695139:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843208.695240:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775743360 00000100:00100000:1.0:1788843208.695252:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775743360 00000100:00100000:1.0:1788843208.695328:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:1.0:1788843208.695362:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+6:10449:x1875737775743360:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788843208.695385:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843208.695421:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c2c7970/0xc6b8ac1b091526b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c60708493d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.695469:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915264 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084936 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.695480:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843208.695485:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843208.695491:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c2c7970/0xc6b8ac1b091526b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708493d expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.695534:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915264 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084936 expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.695551:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915264 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084936 expref: 7 pid: 6694 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843208.695567:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab51454a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1875737795689344:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843208.695693:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab73b8ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843208.700897:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843208.701059:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab51454a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1875737795689344:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843208.701106:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c2c7970/0xc6b8ac1b091526b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c60708493d expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.701133:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933a000, rc 0) 00000100:00100000:3.0:1788843208.701215:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43783100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:10449:x1875737775743360:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 5876us (6088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843208.701224:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:0.0:1788843208.701361:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775743488 00000100:00100000:0.0:1788843208.701371:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775743488 00010000:00010000:0.0:1788843208.701412:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915264 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084936 expref: 7 pid: 6694 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843208.701447:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:0.0:1788843208.701468:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51550850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2358:x1875737775743488:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843208.701504:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843208.701534:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915264 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084936 expref: 7 pid: 6694 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.701549:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915264 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084936 expref: 7 pid: 6694 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.701580:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915264 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084936 expref: 7 pid: 6694 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.701598:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843208.701615:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843208.701625:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004c2c7970/0xc6b8ac1b091526b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x34e059c60708493d expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.701635:0:7638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c2c7970/0xc6b8ac1b091526b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x34e059c60708493d expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.701675:0:7638:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004c2c7970/0xc6b8ac1b091526b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c60708493d expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843208.701692:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43782680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7638:1875737795689472:192.168.203.29@tcp:105: 00000100:00100000:0.0:1788843208.701772:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab43c2cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843208.708833:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843208.709020:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775743616 00000100:00100000:3.0:1788843208.709035:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775743616 00002000:00100000:3.0:1788843208.709110:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8dab51454a80 x1875737775743616/t0(0) o4->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:579/0 lens 504/0 e 0 to 0 dl 1788843219 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788843208.709124:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab51454a80 with x1875737775743616 ext(0->8) 00002000:00010000:3.0:1788843208.709130:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dab51454a80 00000100:00100000:3.0:1788843208.709170:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:3.0:1788843208.709181:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2359:x1875737775743616:12345-192.168.203.29@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788843208.710432:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51454a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+9:2359:x1875737775743616:12345-192.168.203.29@tcp:4:lhsmtool_posix.0 Request processed in 1244us (1606us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788843208.710747:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00002000:00100000:3.0:1788843208.710766:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8dab51454a80 x1875737775743616/t4294967302(0) o4->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:579/0 lens 504/448 e 0 to 0 dl 1788843219 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788843208.710999:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab51454a80 with x1875737775743616 ext(0->8) 00002000:00010000:3.0:1788843208.711018:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dab51454a80 00000100:00100000:0.0:1788843208.711731:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43782680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:7638:1875737795689472:192.168.203.29@tcp:105: 00010000:00010000:0.0:1788843208.711764:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843208.711834:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51550850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2358:x1875737775743488:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 10368us (10949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843208.712070:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:1.0:1788843208.717192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843208.717436:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775743744 00000100:00100000:0.0:1788843208.717504:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775743744 00000100:00100000:0.0:1788843208.717581:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 80 00000100:00100000:0.0:1788843208.717594:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+17:10449:x1875737775743744:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788843208.769815:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1788843208.769836:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788843208.769859:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:0.0:1788843208.770078:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795689600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788843208.770171:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1788843208.770319:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1788843208.770333:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788843208.773180:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+13:10449:x1875737775743744:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 Request processed in 55570us (55992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843208.773211:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 80 00000100:00100000:1.0:1788843208.773277:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795689600 00000100:00100000:1.0:1788843208.773338:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795689600 00000100:00080000:2.0:1788843208.773414:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843208.773435:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843208.773446:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795689600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788843208.773705:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788843208.773710:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788843208 00002000:00010000:1.0:1788843208.773713:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788843208.773714:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788843208 -> 1788843208 00002000:00010000:1.0:1788843208.773717:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788843208.773828:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1875737795689600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 383us (3658us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788843208.773837:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1788843208.774120:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dab43782680/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788843208.774133:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43782680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795689600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788843208.795734:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843208.796005:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775743872 00000100:00100000:3.0:1788843208.796019:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775743872 00000100:00100000:3.0:1788843208.796133:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:3.0:1788843208.796145:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2359:x1875737775743872:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788843208.875633:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788843208.875658:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1788843208.876184:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2359:x1875737775743872:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 Request processed in 80030us (80459us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843208.876200:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:1.0:1788843208.885018:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843208.885082:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775744128 00000100:00100000:1.0:1788843208.885095:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775744128 00000100:00100000:1.0:1788843208.885274:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00100000:1.0:1788843208.885290:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+13:10449:x1875737775744128:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788843208.885413:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843208.886530:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091525d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708492f expref: 13 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.886558:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dab61f39000) 00010000:00010000:1.0:1788843208.886567:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843208.886696:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915272 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.886715:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915272 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.886727:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915272 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843208.887183:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007abd3b2f reply state 000000002c9c115f transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915272 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843208.887197:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788843208.887386:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+14:10449:x1875737775744128:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 2098us (2380us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788843208.887400:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00100000:1.0:1788843208.892259:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843208.892403:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775744256 00000100:00100000:0.0:1788843208.892418:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775744256 00000100:00100000:0.0:1788843208.892511:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:0.0:1788843208.892528:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2359:x1875737775744256:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00010000:00010000:3.0:1788843208.893026:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915272 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.893052:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915272 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.893060:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915272 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.893066:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843208.893073:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915272 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.893083:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915272 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.893106:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dab61f39000) 00010000:00010000:3.0:1788843208.893110:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843208.893116:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915272 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.893139:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915272 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843208.893164:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788843208.893168:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788843208 -> 1788843207 00002000:00010000:0.0:1788843208.893171:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788843205 00002000:00010000:0.0:1788843208.893174:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788843208 -> 1788843207 00002000:00010000:0.0:1788843208.893176:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788843208.893983:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2359:x1875737775744256:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 1452us (1734us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788843208.893995:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:1.0:1788843208.896976:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843208.897132:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775744512 00000100:00100000:0.0:1788843208.897146:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775744512 00000100:00100000:0.0:1788843208.897246:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 82 00000100:00100000:0.0:1788843208.897260:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+13:10449:x1875737775744512:12345-192.168.203.29@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788843208.897419:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915279 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.897442:0:7168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091523a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084921 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.897453:0:7168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915279 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.897506:0:7168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091523a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084921 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.897529:0:7168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091523a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084921 expref: 13 pid: 5847 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843208.897548:0:7168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43780e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7168:1875737795689728:192.168.203.29@tcp:104: 00000100:00100000:0.0:1788843208.897685:0:7168:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab515923c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843208.904197:0:7168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43780e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7168:1875737795689728:192.168.203.29@tcp:104: 00010000:00010000:0.0:1788843208.904245:0:7168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915279 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843208.904261:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843208.904758:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775744640 00000100:00100000:3.0:1788843208.904769:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775744640 00010000:00010000:3.0:1788843208.904824:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091523a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084921 expref: 14 pid: 5847 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843208.904969:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:0.0:1788843208.905002:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+14:2358:x1875737775744640:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843208.905025:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843208.905033:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091523a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084921 expref: 14 pid: 5847 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.905084:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091523a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084921 expref: 14 pid: 5847 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.905115:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091523a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084921 expref: 14 pid: 5847 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.905150:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dab61f39000) 00010000:00010000:0.0:1788843208.905156:0:6708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915279 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.905167:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915279 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.905187:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915279 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.905218:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843208.905293:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+13:2358:x1875737775744640:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 311us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843208.905301:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 43 00010000:00010000:2.0:1788843208.905633:0:7168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915279 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.905654:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915279 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.905719:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915279 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.905728:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915279 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.905737:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915279 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.905744:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843208.905750:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915279 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.905759:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915279 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.905779:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dab61f39000) 00010000:00010000:2.0:1788843208.905783:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788843208.905789:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915279 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.905794:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915279 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843208.905911:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+12:10449:x1875737775744512:12345-192.168.203.29@tcp:55:lhsmtool_posix.0 Request processed in 8650us (8949us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788843208.905922:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 82 00000100:00100000:1.0:1788843208.909964:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843208.910377:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775744768 00000100:00100000:3.0:1788843208.910392:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775744768 00000100:00100000:3.0:1788843208.910476:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:3.0:1788843208.910575:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2358:x1875737775744768:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788843208.910647:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915280 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.910675:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c2c7970/0xc6b8ac1b091526b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c60708493d expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.910685:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788843208.910690:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843208.910695:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915280 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.910745:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c2c7970/0xc6b8ac1b091526b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0x34e059c60708493d expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.910764:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c2c7970/0xc6b8ac1b091526b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c60708493d expref: 7 pid: 6692 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843208.910806:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1875737795689856:192.168.203.29@tcp:104: 00000100:00100000:3.0:1788843208.910929:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab48bae480 going to sleep for 11 seconds 00000100:00100000:0.0:1788843208.915718:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843208.915887:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc1dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1875737795689856:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843208.915928:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915280 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843208.916274:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775744896 00000100:00100000:1.0:1788843208.916284:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775744896 00010000:00010000:1.0:1788843208.916559:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c2c7970/0xc6b8ac1b091526b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c60708493d expref: 8 pid: 6692 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843208.916647:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:1.0:1788843208.916660:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2359:x1875737775744896:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843208.916681:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843208.916714:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c2c7970/0xc6b8ac1b091526b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c60708493d expref: 8 pid: 6692 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.916755:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c2c7970/0xc6b8ac1b091526b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c60708493d expref: 8 pid: 6692 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.916814:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c2c7970/0xc6b8ac1b091526b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0x34e059c60708493d expref: 8 pid: 6692 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.916843:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843208.917014:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843208.917024:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915280 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.917050:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915280 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.917098:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843208.917167:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915280 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843208.917194:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2359:x1875737775744896:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 533us (1487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843208.917205:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 44 00010000:00010000:2.0:1788843208.917236:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915280 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.917298:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915280 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.917308:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915280 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.917317:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.917327:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843208.917334:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915280 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.917374:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915280 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.917404:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915280 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.917413:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915280 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843208.917590:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775744768:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 Request processed in 7006us (7627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843208.917600:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:0.0:1788843208.925794:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843208.925970:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775745152 00000100:00100000:1.0:1788843208.925984:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775745152 00000100:00100000:1.0:1788843208.926077:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 83 00000100:00100000:1.0:1788843208.926092:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+12:10449:x1875737775745152:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788843208.926224:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915287 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.926249:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915287 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.926282:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915287 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.926635:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b091528e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.926652:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0915248 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084928 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.926662:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b091528e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.926712:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0915248 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084928 expref: 13 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.926732:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0915248 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084928 expref: 13 pid: 5847 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843208.926751:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e77d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795689984:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843208.927153:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4936a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788843208.929648:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e77d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795689984:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843208.929692:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b091528e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843208.930104:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843208.930266:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775745280 00000100:00100000:2.0:1788843208.930275:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775745280 00010000:00010000:2.0:1788843208.930322:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0915248 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084928 expref: 14 pid: 5847 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843208.930395:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:2.0:1788843208.930406:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+14:2358:x1875737775745280:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843208.930424:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843208.930432:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0915248 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084928 expref: 14 pid: 5847 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.930447:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0915248 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084928 expref: 14 pid: 5847 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.930476:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0915248 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084928 expref: 14 pid: 5847 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.930497:0:7638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dab61f39000) 00010000:00010000:2.0:1788843208.930504:0:7638:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b091528e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.930514:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b091528e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.930544:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b091528e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843208.930574:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843208.930643:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43783800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+13:2358:x1875737775745280:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 237us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843208.930651:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 45 00010000:00010000:1.0:1788843208.930964:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b091528e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.930974:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b091528e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788843208.932023:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1788843208.933541:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1788843208.933634:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1788843208.933760:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e77d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1875737795690112:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788843208.937018:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843208.937088:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab50c45c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843208.937276:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795690112 00000100:00100000:2.0:1788843208.937290:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795690112 00000100:00100000:2.0:1788843208.937989:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843208.938004:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875737795690112:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788843208.938159:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1875737795690112:12345-0@lo:1000:mdt00_000.0 Request processed in 160us (1151us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843208.938168:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788843208.938323:0:5846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788843208.938409:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dab43782680, transno 4294967303 00000100:00100000:1.0:1788843208.938516:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e77d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1875737795690112:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788843208.939247:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1788843208.939394:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e77d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1875737795690240:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788843208.940842:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843208.940957:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab436f00c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843208.941742:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795690240 00000100:00100000:0.0:1788843208.941754:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795690240 00000100:00100000:0.0:1788843208.941829:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843208.941843:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1875737795690240:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788843208.942548:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1875737795690240:12345-0@lo:1000:mdt00_000.0 Request processed in 705us (1710us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788843208.942581:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843208.942813:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e77d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1875737795690240:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788843208.942892:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b091528e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.942907:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b091528e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.942916:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b091528e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.942924:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933bc00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843208.942930:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b091528e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.942940:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b091528e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.942973:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dab61f39000) 00010000:00010000:1.0:1788843208.942977:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843208.942984:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b091528e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.942992:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b091528e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.943088:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09151bc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.943096:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09151bc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.943103:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09151bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.943108:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843208.943111:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09151bc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.943118:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09151bc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.943128:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63c00) 00010000:00010000:1.0:1788843208.943130:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843208.943133:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09151bc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.943139:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09151bc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.943569:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915295 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.943592:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09151d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708490c expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.943603:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915295 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.943654:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09151d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708490c expref: 16 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.943673:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09151d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708490c expref: 16 pid: 5848 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843208.943691:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e77f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795690368:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843208.944126:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab436f00c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843208.948433:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e77f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795690368:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843208.948484:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915295 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843208.950055:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843208.950137:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775745408 00000100:00100000:0.0:1788843208.950151:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775745408 00010000:00010000:0.0:1788843208.950230:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09151d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708490c expref: 17 pid: 5848 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843208.950283:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:0.0:1788843208.950297:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+17:2358:x1875737775745408:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843208.950321:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843208.950366:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09151d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708490c expref: 17 pid: 5848 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.950384:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09151d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708490c expref: 17 pid: 5848 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.950418:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09151d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708490c expref: 17 pid: 5848 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.950444:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63c00) 00010000:00010000:0.0:1788843208.950450:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915295 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.950463:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915295 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.950474:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915295 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843208.950538:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843208.950623:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+16:2358:x1875737775745408:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 328us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843208.950632:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 46 00010000:00010000:1.0:1788843208.950915:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915295 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.950926:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915295 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.950944:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915295 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.950961:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915295 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.950968:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915295 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.950974:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933be00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843208.950979:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915295 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.950987:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915295 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.950997:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63c00) 00010000:00010000:1.0:1788843208.951001:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843208.951005:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915295 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.951010:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915295 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.951054:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915287 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.951060:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915287 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.951065:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915287 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.951070:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933a000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843208.951080:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915287 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.951086:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915287 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.951095:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63c00) 00010000:00010000:1.0:1788843208.951097:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788843208.951100:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915287 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.951106:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915287 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843208.951478:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+15:10449:x1875737775745152:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 25386us (25712us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788843208.951489:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 83 00000020:00080000:1.0:1788843208.951494:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788843208.953152:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788843208.953166:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788843208.954101:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788843208.954116:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788843208.962621:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843208.962974:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775745664 00000100:00100000:3.0:1788843208.962991:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775745664 00000100:00100000:3.0:1788843208.963118:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1788843208.963133:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+15:10449:x1875737775745664:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788843208.964193:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788843208.964323:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788843208.964427:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091529c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.964453:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091529c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.964468:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091529c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.964479:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091529c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.964485:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091529c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.964500:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091529c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843208.964531:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788843208.964676:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+17:10449:x1875737775745664:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 1543us (2081us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788843208.964686:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000020:00080000:3.0:1788843208.964693:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788843208.964799:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843208.964809:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091529c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.964818:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843208.964823:0:7637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091529c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.964835:0:7637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091529c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.964853:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:1.0:1788843208.964857:0:7637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788843208.964872:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091529c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.964879:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b091529c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843208.964907:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843208.964910:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843208.964911:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843209.481214:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843209.885071:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843209.885264:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843209.885310:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843209.885333:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843209.885393:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843209.885477:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775746176 00000100:00100000:3.0:1788843209.885492:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775746176 00000100:00100000:3.0:1788843209.885594:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775746048 00000100:00100000:3.0:1788843209.885598:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775746048 00000100:00100000:3.0:1788843209.885626:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 73 00000100:00100000:3.0:1788843209.885638:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2356:x1875737775746176:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843209.885757:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2356:x1875737775746176:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 121us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843209.885767:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 73 00000100:00100000:3.0:1788843209.885787:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 74 00000100:00100000:3.0:1788843209.885794:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2356:x1875737775746048:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843209.885825:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2356:x1875737775746048:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 32us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843209.885832:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 74 00000100:00080000:3.0:1788843209.885878:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843209.886056:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775745792 00000100:00100000:3.0:1788843209.886061:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775745792 00000100:00100000:3.0:1788843209.886101:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 282 00000100:00100000:3.0:1788843209.886108:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2356:x1875737775745792:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843209.886367:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2356:x1875737775745792:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 232us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843209.886376:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 282 00000100:00100000:2.0:1788843209.887438:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775745920 00000100:00100000:2.0:1788843209.887457:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775745920 00000100:00100000:2.0:1788843209.887559:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775746304 00000100:00100000:2.0:1788843209.887563:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775746304 00000100:00100000:3.0:1788843209.887833:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 130 00000100:00100000:3.0:1788843209.887846:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+17:2356:x1875737775745920:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843209.887931:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+17:2356:x1875737775745920:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 88us (2876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843209.887939:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 130 00000100:00080000:1.0:1788843209.888546:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843209.888823:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 131 00000100:00100000:2.0:1788843209.888835:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2356:x1875737775746304:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843209.888905:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2356:x1875737775746304:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 72us (3510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843209.888913:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 131 00000100:00100000:1.0:1788843210.052852:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795690496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843210.052949:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843210.053071:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795690496 00000100:00100000:0.0:1788843210.053079:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795690496 00000100:00100000:0.0:1788843210.053143:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788843210.053153:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875737795690496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843210.053189:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843210.053255:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1875737795690496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843210.053263:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788843210.053590:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43781880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795690496:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788843210.053614:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:0.0:1788843210.386334:0:12055:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788843210.386367:0:12055:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788843210.386409:0:12055:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788843210.386415:0:12055:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788843210.487993:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843210.488182:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775746560 00000100:00100000:2.0:1788843210.488202:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775746560 00000100:00100000:2.0:1788843210.488283:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 84 00000100:00100000:2.0:1788843210.488295:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+17:10469:x1875737775746560:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843210.488316:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843210.488466:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09152a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084944 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.488662:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b09152aa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.488677:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b09152aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.488690:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b09152aa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843210.488702:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788843210.488826:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09152a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084944 expref: 20 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.488846:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b09152aa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084944 expref: 19 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.488855:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:2.0:1788843210.488858:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788843210.488862:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88000, rc 0) 00000100:00100000:2.0:1788843210.488966:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+19:10469:x1875737775746560:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 674us (983us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788843210.488973:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 84 00000100:00100000:2.0:1788843210.497199:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843210.499972:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775746688 00000100:00100000:1.0:1788843210.499989:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775746688 00000100:00100000:1.0:1788843210.500107:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:1.0:1788843210.500120:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+19:10469:x1875737775746688:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:1.0:1788843210.500210:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b09152b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.500228:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b09152b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.500240:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b09152b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.500265:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b09152bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.500273:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b09152bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.500280:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b09152bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.505153:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843210.509366:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09152c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.509388:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09152c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.509400:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09152c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788843210.510180:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09152c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510204:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b09152b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510211:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b09152b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510218:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b09152b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510226:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933ac00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843210.510231:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b09152b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510239:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b09152b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510257:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:0.0:1788843210.510261:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843210.510267:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b09152b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510273:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b09152b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510290:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b09152bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510297:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b09152bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510313:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b09152bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510319:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843210.510322:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b09152bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510329:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b09152bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510338:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab61f39000) 00010000:00010000:0.0:1788843210.510368:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843210.510372:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b09152bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510378:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b09152bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510398:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09152c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510404:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09152c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510410:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09152c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510415:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843210.510419:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09152c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510437:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09152c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510447:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43ecec00) 00010000:00010000:0.0:1788843210.510453:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843210.510457:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09152c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.510462:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09152c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843210.510665:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+19:10469:x1875737775746688:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 10541us (13470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843210.510676:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:3.0:1788843210.555420:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843210.555460:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775746944 00000100:00100000:3.0:1788843210.555471:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775746944 00000100:00100000:3.0:1788843210.555537:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 86 00000100:00100000:3.0:1788843210.555549:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+19:10472:x1875737775746944:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843210.555573:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843210.555597:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09152cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c60708494b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.555671:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09152d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.555687:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09152d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.555710:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09152d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.555739:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.555747:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.555755:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556047:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09152e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556057:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09152e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556064:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09152e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843210.556073:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788843210.556186:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09152d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556195:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09152d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556201:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09152d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556208:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843210.556212:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09152d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556229:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09152d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556242:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:3.0:1788843210.556246:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843210.556251:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09152d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556258:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09152d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556273:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556280:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556286:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556291:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843210.556294:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556300:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556307:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab43e63b00) 00010000:00010000:3.0:1788843210.556310:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843210.556313:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556327:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556394:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09152cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708494b expref: 22 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556412:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09152e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708494b expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.556420:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:3.0:1788843210.556422:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843210.556425:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82054e00, rc 0) 00000100:00100000:3.0:1788843210.556493:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+21:10472:x1875737775746944:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 945us (1084us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788843210.556501:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 86 00000100:00100000:3.0:1788843210.561012:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843210.561130:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775747072 00000100:00100000:2.0:1788843210.561141:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775747072 00000100:00100000:2.0:1788843210.561201:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 87 00000100:00100000:2.0:1788843210.561212:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+21:10472:x1875737775747072:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:2.0:1788843210.561278:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09152f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.561294:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09152f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.561307:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09152f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.561335:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09152f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.561365:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09152f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.561371:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09152f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.561377:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff89800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843210.561381:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09152f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.561389:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09152f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.561400:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:2.0:1788843210.561404:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843210.561416:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09152f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.561423:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b09152f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843210.561506:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+21:10472:x1875737775747072:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 295us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843210.561514:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 87 00000100:00100000:2.0:1788843210.565633:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843210.565796:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775747328 00000100:00100000:0.0:1788843210.565805:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775747328 00000100:00100000:0.0:1788843210.565860:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:0.0:1788843210.565873:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6640d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+21:10472:x1875737775747328:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:0.0:1788843210.566118:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6640d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+22:10472:x1875737775747328:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 247us (495us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788843210.566127:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:2.0:1788843210.603278:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843210.603512:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775747584 00000100:00100000:3.0:1788843210.603526:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775747584 00000100:00100000:3.0:1788843210.603620:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 88 00000100:00100000:3.0:1788843210.603639:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+22:9992:x1875737775747584:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1788843210.603673:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843210.603704:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09152f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084952 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.603937:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.603981:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09152e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708494b expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.603992:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152fe lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.604160:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09152e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708494b expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.604179:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09152e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708494b expref: 23 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843210.604197:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1875737795690624:192.168.203.29@tcp:104: 00000100:00100000:3.0:1788843210.604656:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab48bae000 going to sleep for 11 seconds 00000100:00100000:3.0:1788843210.612618:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc1e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1875737795690624:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843210.612661:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843210.614287:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843210.615168:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775747712 00000100:00100000:1.0:1788843210.615184:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775747712 00010000:00010000:0.0:1788843210.615510:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09152e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708494b expref: 24 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843210.615611:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:0.0:1788843210.615623:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+24:2359:x1875737775747712:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843210.615642:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843210.615649:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09152e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708494b expref: 24 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.615689:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09152e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708494b expref: 24 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.615720:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09152e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708494b expref: 24 pid: 5848 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.615746:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:0.0:1788843210.615752:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152fe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.615764:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.615773:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152fe lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.615810:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843210.615889:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+23:2359:x1875737775747712:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 268us (1616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843210.615897:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 47 00010000:00010000:3.0:1788843210.615975:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.615986:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152fe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843210.616013:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788843210.616244:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09152f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084952 expref: 24 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.616280:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084952 expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.616289:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:3.0:1788843210.616292:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788843210.616295:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82055e00, rc 0) 00000100:00100000:3.0:1788843210.617165:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+23:9992:x1875737775747584:12345-192.168.203.29@tcp:101:bash.0 Request processed in 13526us (13893us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788843210.617176:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 88 00000100:00100000:2.0:1788843210.621058:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843210.623387:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775747968 00000100:00100000:0.0:1788843210.623410:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775747968 00000100:00100000:0.0:1788843210.623574:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 89 00000100:00100000:0.0:1788843210.623588:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+23:9992:x1875737775747968:12345-192.168.203.29@tcp:36:bash.0 00010000:00010000:0.0:1788843210.623965:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b091530c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.623988:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b091530c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.624020:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b091530c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843210.624096:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788843210.624123:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7d6adf0 reply state 00000000b6a51f9d transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b091530c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843210.624133:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788843210.624182:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788843210.624322:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+27:9992:x1875737775747968:12345-192.168.203.29@tcp:36:bash.0 Request processed in 735us (3276us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788843210.624330:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 89 00000020:00080000:0.0:1788843210.624336:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788843210.627638:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843210.627975:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775748096 00000100:00100000:3.0:1788843210.627990:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775748096 00000100:00100000:3.0:1788843210.628131:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 90 00000100:00100000:3.0:1788843210.628145:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+27:9992:x1875737775748096:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1788843210.628179:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843210.628208:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0915313 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084959 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.628287:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0915313 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084959 expref: 28 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.628305:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0915313 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084959 expref: 28 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.628330:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:3.0:1788843210.628334:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843210.628399:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82055000, rc 0) 00000100:00100000:3.0:1788843210.628472:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73924000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+28:9992:x1875737775748096:12345-192.168.203.29@tcp:101:bash.0 Request processed in 330us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843210.628480:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 90 00010000:00010000:1.0:1788843210.628747:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b091530c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.628757:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b091530c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.628765:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b091530c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.628772:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843210.628777:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b091530c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.628786:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b091530c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.628814:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:1.0:1788843210.628816:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843210.628821:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b091530c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.628828:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b091530c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843210.635544:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843210.635614:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775748224 00000100:00100000:3.0:1788843210.635627:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775748224 00000100:00080000:1.0:1788843210.635687:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843210.635718:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:3.0:1788843210.635732:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:9992:x1875737775748224:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1788843210.635758:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843210.635792:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b091531a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084960 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788843210.635830:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f94c7, atime: 0x6a9f94c5, ctime: 0x6a9f94c7, blocks: 0xb 00010000:00010000:3.0:1788843210.635862:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=334s v=(0 0) 00010000:00010000:3.0:1788843210.635868:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843210.635878:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b091531a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084960 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.635900:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b091531a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084960 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.635916:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82055800, rc 0) 00000100:00100000:3.0:1788843210.636003:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+7:9992:x1875737775748224:12345-192.168.203.29@tcp:101:bash.0 Request processed in 273us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843210.636012:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:1.0:1788843210.640004:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843210.640841:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775748352 00000100:00100000:0.0:1788843210.640857:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775748352 00002000:00010000:0.0:1788843210.640919:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1788843210.640925:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab6e77ea00 with x1875737775748352 ext(0->18446744073709551615) 00002000:00010000:0.0:1788843210.640941:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dab6e77ea00. 00000100:00100000:0.0:1788843210.640985:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:0.0:1788843210.640997:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2358:x1875737775748352:12345-192.168.203.29@tcp:10:bash.0 00002000:00010000:0.0:1788843210.641424:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788843210.641428:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788843207 -> 1788843210 00002000:00010000:0.0:1788843210.641431:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788843205 -> 1788843205 00002000:00010000:0.0:1788843210.641434:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788843207 -> 1788843210 00002000:00010000:0.0:1788843210.641436:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788843210.641516:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2358:x1875737775748352:12345-192.168.203.29@tcp:10:bash.0 Request processed in 520us (1526us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788843210.641540:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00002000:00010000:0.0:1788843210.641544:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1788843210.641547:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab6e77ea00 with x1875737775748352 ext(0->18446744073709551615) 00002000:00010000:0.0:1788843210.641551:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dab6e77ea00. 00000100:00100000:2.0:1788843210.712554:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843210.712700:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775748480 00000100:00100000:1.0:1788843210.712713:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775748480 00000100:00100000:1.0:1788843210.712801:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 91 00000100:00100000:1.0:1788843210.712818:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+27:10486:x1875737775748480:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:1.0:1788843210.712916:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915321 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.712939:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915321 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.712952:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915321 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.712971:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915328 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.712979:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.712986:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713293:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091532f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713304:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091532f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713311:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091532f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843210.713415:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091532f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713429:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915321 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713436:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915321 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713443:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915321 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713450:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843210.713455:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915321 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713463:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915321 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713478:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:1.0:1788843210.713481:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843210.713487:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915321 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713501:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915321 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713517:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915328 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713523:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915328 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713529:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915328 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713534:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843210.713538:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915328 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713544:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915328 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713552:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab61f39100) 00010000:00010000:1.0:1788843210.713554:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843210.713558:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915328 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713564:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915328 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713580:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091532f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713587:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091532f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713599:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091532f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713605:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843210.713608:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091532f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713614:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091532f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713623:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:1.0:1788843210.713625:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843210.713628:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091532f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.713634:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b091532f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843210.713733:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+27:10486:x1875737775748480:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 918us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843210.713742:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 91 00000100:00100000:3.0:1788843210.768942:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843210.769093:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775748736 00000100:00100000:2.0:1788843210.769106:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775748736 00000100:00100000:2.0:1788843210.769192:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 92 00000100:00100000:2.0:1788843210.769205:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+27:10489:x1875737775748736:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843210.769236:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843210.769267:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915336 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084967 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.769412:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091533d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.769432:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091533d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.769448:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091533d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.769487:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915344 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.769496:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.769504:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.769859:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091534b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.769870:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091534b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.769878:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091534b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843210.769889:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788843210.770010:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091533d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.770019:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091533d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.770036:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091533d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.770043:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843210.770048:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091533d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.770070:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091533d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.770084:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:2.0:1788843210.770088:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843210.770093:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091533d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.770100:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091533d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.770115:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915344 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.770121:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915344 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.770127:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.770133:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843210.770136:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915344 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.770142:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915344 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.770148:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab54910c00) 00010000:00010000:2.0:1788843210.770151:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843210.770153:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915344 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.770169:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915344 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.770218:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915336 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084967 expref: 30 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.770234:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091534b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084967 expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.770242:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:2.0:1788843210.770245:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788843210.770247:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88200, rc 0) 00000100:00100000:2.0:1788843210.770604:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+29:10489:x1875737775748736:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1400us (1676us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788843210.770615:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 92 00000100:00100000:2.0:1788843210.773876:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843210.774020:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775748864 00000100:00100000:0.0:1788843210.774041:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775748864 00000100:00100000:0.0:1788843210.774128:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 93 00000100:00100000:0.0:1788843210.774141:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+29:10489:x1875737775748864:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:0.0:1788843210.774239:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915359 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.774259:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152fe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084952 expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.774270:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915359 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.774317:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084952 expref: 29 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843210.774333:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084952 expref: 29 pid: 5848 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843210.774384:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43782d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795690752:192.168.203.29@tcp:104: 00000100:00100000:0.0:1788843210.774512:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51592840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843210.780285:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43782d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795690752:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843210.780326:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915359 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843210.780956:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843210.781561:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775749120 00000100:00100000:0.0:1788843210.781572:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775749120 00000100:00100000:0.0:1788843210.781754:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:0.0:1788843210.781766:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+30:5596:x1875737775749120:12345-192.168.203.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788843210.782253:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+31:5596:x1875737775749120:12345-192.168.203.29@tcp:35:ldlm_bl.0 Request processed in 485us (1297us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788843210.782263:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:0.0:1788843210.784884:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843210.784986:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775749248 00000100:00100000:1.0:1788843210.784997:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775749248 00010000:00010000:1.0:1788843210.785064:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084952 expref: 31 pid: 5848 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843210.785114:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:1.0:1788843210.785126:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+31:2359:x1875737775749248:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843210.785144:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843210.785171:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152fe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084952 expref: 31 pid: 5848 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.785186:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152fe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084952 expref: 31 pid: 5848 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.785216:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09152fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084952 expref: 31 pid: 5848 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.785238:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:1.0:1788843210.785245:0:6708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915359 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.785256:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.785265:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915359 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.785303:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843210.785414:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+30:2359:x1875737775749248:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 289us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843210.785423:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 48 00010000:00010000:2.0:1788843210.785569:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.785579:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.785627:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.785644:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915359 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.785651:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.785658:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843210.785664:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.785672:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915359 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.785683:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:2.0:1788843210.785686:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843210.785689:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915359 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.785696:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915359 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843210.785747:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+29:10489:x1875737775748864:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 11608us (11884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843210.785757:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 93 00000100:00100000:2.0:1788843210.789102:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843210.789194:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775749504 00000100:00100000:3.0:1788843210.789225:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775749504 00000100:00100000:3.0:1788843210.789296:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:3.0:1788843210.789310:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+29:10489:x1875737775749504:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:3.0:1788843210.789680:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+30:10489:x1875737775749504:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 371us (591us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788843210.789690:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:2.0:1788843210.860050:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843210.860153:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775749760 00000100:00100000:3.0:1788843210.860166:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775749760 00000100:00100000:3.0:1788843210.860248:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 94 00000100:00100000:3.0:1788843210.860261:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+30:10500:x1875737775749760:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:3.0:1788843210.860297:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843210.860329:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0915360 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c60708496e expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.860450:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915367 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.860469:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915367 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.860483:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915367 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.860500:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b091536e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.860507:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b091536e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.860513:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b091536e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.860870:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0915375 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.860881:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0915375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.860889:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0915375 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843210.860900:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788843210.861035:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915367 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.861043:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915367 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.861052:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915367 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.861058:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843210.861063:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915367 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.861071:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915367 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.861086:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:3.0:1788843210.861089:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843210.861094:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915367 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.861101:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b0915367 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.861125:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b091536e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.861131:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b091536e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.861138:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b091536e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.861143:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41532e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843210.861146:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b091536e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.861151:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b091536e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.861157:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab43e63500) 00010000:00010000:3.0:1788843210.861160:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843210.861162:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b091536e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.861168:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b091536e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.861224:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b0915360 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708496e expref: 33 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.861242:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0915375 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708496e expref: 32 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.861260:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:3.0:1788843210.861262:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843210.861265:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41532a00, rc 0) 00000100:00100000:3.0:1788843210.861413:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+32:10500:x1875737775749760:12345-192.168.203.29@tcp:101:cat.0 Request processed in 1154us (1389us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788843210.861423:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 94 00000100:00100000:2.0:1788843210.865236:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843210.865380:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775750016 00000100:00100000:3.0:1788843210.865394:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775750016 00000100:00100000:3.0:1788843210.865461:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:3.0:1788843210.865474:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+32:10500:x1875737775750016:12345-192.168.203.29@tcp:35:cat.0 00000100:00100000:3.0:1788843210.866126:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+33:10500:x1875737775750016:12345-192.168.203.29@tcp:35:cat.0 Request processed in 651us (902us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788843210.866136:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:0.0:1788843210.884918:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843210.886008:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775750272 00000100:00100000:1.0:1788843210.886035:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775750272 00000100:00100000:1.0:1788843210.886129:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 95 00000100:00100000:1.0:1788843210.886142:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+33:10501:x1875737775750272:12345-192.168.203.29@tcp:36:rm.0 00010000:00010000:1.0:1788843210.886226:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788843210.886259:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b0915375 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708496e expref: 33 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.886310:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b091534b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084967 expref: 32 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.886325:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0915313 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084959 expref: 31 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.886399:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab43e63e00) 00010000:00010000:1.0:1788843210.886419:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843210.886449:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915383 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.886465:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915383 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.886477:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915383 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.886494:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b091538a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.886501:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b091538a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.886508:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b091538a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.886823:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915391 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.886833:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915391 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.886848:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915391 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788843210.887590:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:1.0:1788843210.887604:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335138261815ns, next at 336138257726ns, rc = 0 00010000:00010000:1.0:1788843210.887688:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915398 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887702:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915398 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887712:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915398 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887722:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915398 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887729:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915398 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887736:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915398 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887771:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843210.887802:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915391 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887809:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915391 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887816:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915391 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887829:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843210.887835:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915391 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887843:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915391 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887855:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:1.0:1788843210.887859:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788843210.887864:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915391 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887871:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915391 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887894:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915383 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887900:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915383 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887907:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915383 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887912:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843210.887914:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915383 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887920:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915383 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887937:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:1.0:1788843210.887939:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843210.887942:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915383 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.887949:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915383 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843210.887959:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081e32a1b reply state 0000000051048baa transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b091538a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843210.887968:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788843210.888110:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+32:10501:x1875737775750272:12345-192.168.203.29@tcp:36:rm.0 Request processed in 1965us (3201us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788843210.888121:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 95 00010000:00010000:2.0:1788843210.889118:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843210.889130:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915398 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.889158:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933ae00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843210.889162:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915398 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.889171:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915398 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.889187:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dab61f39c00) 00010000:00010000:2.0:1788843210.889190:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788843210.889194:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915398 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.889201:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b0915398 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843210.889227:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843210.889229:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843210.889230:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843210.891375:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b091538a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.891396:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b091538a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.891404:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b091538a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.891410:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843210.891415:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b091538a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.891423:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b091538a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.891698:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab61f39100) 00010000:00010000:3.0:1788843210.891703:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843210.891708:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b091538a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.891716:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b091538a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843210.922768:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843210.923131:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775750528 00000100:00100000:3.0:1788843210.923148:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775750528 00000100:00100000:3.0:1788843210.923521:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 96 00000100:00100000:3.0:1788843210.923535:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+31:10507:x1875737775750528:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1788843210.923570:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843210.923611:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b091539f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084975 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.923777:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b09153a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.923798:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b09153a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.923813:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b09153a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.923832:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09153ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.923841:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09153ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.923868:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09153ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788843210.928649:0:7168:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788843210.928974:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09153b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.928996:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09153b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.929011:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09153b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.929068:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b09153a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.929077:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b09153a6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.929149:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b09153a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.929157:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41532a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843210.929163:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b09153a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.930079:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b09153a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.930314:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:3.0:1788843210.930318:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843210.930373:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b09153a6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.930383:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b09153a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843210.930411:0:7168:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa90641e reply state 0000000009e52bee transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09153ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843210.930424:0:7168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788843210.930491:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b091539f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084975 expref: 34 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.930521:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09153b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084975 expref: 33 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.930530:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab43e63000) 00010000:00010000:3.0:1788843210.930533:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843210.930535:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82054e00, rc 0) 00000100:00100000:3.0:1788843210.930648:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+34:10507:x1875737775750528:12345-192.168.203.29@tcp:101:bash.0 Request processed in 7114us (7893us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788843210.930660:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 96 00010000:00010000:1.0:1788843210.933042:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09153ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.933063:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09153ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.933072:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09153ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.933079:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843210.933153:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09153ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.933170:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09153ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.933214:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab43e63500) 00010000:00010000:1.0:1788843210.933218:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843210.933330:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09153ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.933585:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b09153ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843210.937149:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843210.937733:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775750656 00000100:00100000:3.0:1788843210.937750:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775750656 00000100:00100000:3.0:1788843210.937869:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:3.0:1788843210.937940:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2356:x1875737775750656:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1788843210.937966:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843210.937996:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033823beb/0xc6b8ac1b09153c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c60708497c expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788843210.938074:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788843210.938102:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=335s v=(0 0) 00010000:00010000:3.0:1788843210.938107:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843210.938121:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033823beb/0xc6b8ac1b09153c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708497c expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.938147:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000033823beb/0xc6b8ac1b09153c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708497c expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.938167:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82055e00, rc 0) 00000100:00100000:3.0:1788843210.938270:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2356:x1875737775750656:12345-192.168.203.29@tcp:101:bash.0 Request processed in 335us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843210.938279:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:2.0:1788843210.941801:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843210.941897:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775750784 00000100:00100000:3.0:1788843210.941908:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775750784 00000100:00100000:3.0:1788843210.941972:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:3.0:1788843210.941984:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+6:10507:x1875737775750784:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1788843210.942006:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843210.942040:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019a76543/0xc6b8ac1b09153c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084983 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.942088:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000033823beb/0xc6b8ac1b09153c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708497c expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.942099:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843210.942119:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843210.942126:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019a76543/0xc6b8ac1b09153c9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084983 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.942166:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000033823beb/0xc6b8ac1b09153c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708497c expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.942181:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000033823beb/0xc6b8ac1b09153c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708497c expref: 7 pid: 6694 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843210.942196:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc1ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1875737795690880:192.168.203.29@tcp:104: 00000100:00100000:3.0:1788843210.942334:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab48bae840 going to sleep for 11 seconds 00000100:00100000:0.0:1788843210.950709:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843210.950907:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775750912 00000100:00100000:1.0:1788843210.950919:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775750912 00010000:00010000:1.0:1788843210.950973:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000033823beb/0xc6b8ac1b09153c2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708497c expref: 8 pid: 6694 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843210.951041:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:1.0:1788843210.951054:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51552450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2358:x1875737775750912:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843210.951078:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843210.951489:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000033823beb/0xc6b8ac1b09153c2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708497c expref: 8 pid: 6694 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.951567:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000033823beb/0xc6b8ac1b09153c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708497c expref: 8 pid: 6694 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.951603:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843210.951608:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843210.951619:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019a76543/0xc6b8ac1b09153c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084983 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.951653:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019a76543/0xc6b8ac1b09153c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084983 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843210.951706:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000019a76543/0xc6b8ac1b09153c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084983 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843210.951724:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e77d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1875737795691008:192.168.203.29@tcp:105: 00010000:00010000:3.0:1788843210.951924:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033823beb/0xc6b8ac1b09153c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c60708497c expref: 8 pid: 6694 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843210.951948:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc1ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1875737795690880:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843210.951980:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000019a76543/0xc6b8ac1b09153c9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084983 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843210.951992:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82055000, rc 0) 00000100:00100000:0.0:1788843210.952839:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7793ab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843210.953673:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:10507:x1875737775750784:12345-192.168.203.29@tcp:101:bash.0 Request processed in 11680us (11874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843210.953685:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:0.0:1788843210.966898:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843210.967196:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775751168 00000100:00100000:2.0:1788843210.967208:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775751168 00000100:00100000:3.0:1788843210.967213:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e77d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5833:1875737795691008:192.168.203.29@tcp:105: 00010000:00010000:3.0:1788843210.967245:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843210.967305:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:2.0:1788843210.967332:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+33:10507:x1875737775751168:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:3.0:1788843210.967421:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51552450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775750912:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 16368us (16725us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843210.967442:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 49 00000001:00080000:2.0:1788843210.967764:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967377 00000100:00100000:2.0:1788843210.967856:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+35:10507:x1875737775751168:12345-192.168.203.29@tcp:35:bash.0 Request processed in 540us (979us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788843210.967864:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 25 00000020:00080000:2.0:1788843210.967868:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:1.0:1788843211.013251:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788843211.013261:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843211.013313:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788843211.013319:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788843211.078447:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795691264:0@lo:400:kworker.0 00000100:00100000:2.0:1788843211.078546:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843211.078654:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788843211.078661:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795691136:0@lo:400:kworker.0 00000100:00100000:2.0:1788843211.078711:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843211.078765:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795691264 00000100:00100000:2.0:1788843211.078774:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795691264 00000100:00100000:2.0:1788843211.078846:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788843211.078859:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795691264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843211.078889:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795691136 00000100:00100000:3.0:1788843211.078896:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795691136 00000100:00100000:3.0:1788843211.078934:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788843211.078944:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795691136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843211.078966:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795691264:12345-0@lo:400:kworker.0 Request processed in 108us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843211.078975:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788843211.078993:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795691136:12345-0@lo:400:kworker.0 Request processed in 50us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843211.079003:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1788843211.079042:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43781c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795691136:0@lo:400:kworker.0 00000100:00100000:2.0:1788843211.079066:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795691264:0@lo:400:kworker.0 00000100:00100000:0.0:1788843211.079223:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795691776:0@lo:400:kworker.0 00000100:00100000:0.0:1788843211.079261:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843211.079277:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795691392:0@lo:400:kworker.0 00000100:00100000:0.0:1788843211.079289:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843211.079298:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795691648:0@lo:400:kworker.0 00000100:00100000:2.0:1788843211.079315:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843211.079365:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843211.079372:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795691520:0@lo:400:kworker.0 00000100:00100000:1.0:1788843211.079572:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795691776 00000100:00100000:1.0:1788843211.079578:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795691776 00000100:00100000:1.0:1788843211.079635:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788843211.079643:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1875737795691776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843211.079962:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795691392 00000100:00100000:3.0:1788843211.079967:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795691392 00000100:00100000:3.0:1788843211.080007:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788843211.080014:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795691392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843211.080272:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1875737795691776:12345-0@lo:400:kworker.0 Request processed in 629us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843211.080281:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788843211.080307:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843211.080312:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843211.080947:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843211.081008:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795691520 00000100:00100000:2.0:1788843211.081016:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795691520 00000100:00100000:2.0:1788843211.081070:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788843211.081079:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875737795691520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843211.081128:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1875737795691520:12345-0@lo:400:kworker.0 Request processed in 51us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843211.081135:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788843211.081191:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843211.081250:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795691776:0@lo:400:kworker.0 00000100:00100000:0.0:1788843211.081336:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795691648 00000100:00100000:0.0:1788843211.081356:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795691648 00000100:00100000:0.0:1788843211.081396:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788843211.081404:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795691648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843211.081455:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43781500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795691520:0@lo:400:kworker.0 00000100:00100000:0.0:1788843211.081462:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795691648:12345-0@lo:400:kworker.0 Request processed in 56us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843211.081472:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:0.0:1788843211.081494:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843211.081528:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43783480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795691648:0@lo:400:kworker.0 00000100:00100000:3.0:1788843211.081642:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795691392:12345-0@lo:400:kworker.0 Request processed in 1627us (2326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843211.081651:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788843211.081796:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43782a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795691392:0@lo:400:kworker.0 00000100:00100000:2.0:1788843211.100243:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843211.100377:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775751296 00000100:00100000:0.0:1788843211.100393:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775751296 00000100:00080000:1.0:1788843211.100433:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843211.100489:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 97 00000100:00100000:0.0:1788843211.100512:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+35:10523:x1875737775751296:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1788843211.100551:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843211.100648:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09153d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c60708498a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.100972:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09153d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.100989:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09153d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.101002:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09153d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843211.101052:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788843211.101056:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788843211.101077:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09153d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.101107:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09153d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708498a expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.101129:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09153d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708498a expref: 36 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.101140:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:0.0:1788843211.101162:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788843211.101167:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4a00, rc 0) 00000100:00100000:0.0:1788843211.102116:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+36:10523:x1875737775751296:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1609us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843211.102128:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 97 00000100:00100000:1.0:1788843211.106479:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843211.106531:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775751552 00000100:00100000:3.0:1788843211.106546:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775751552 00000100:00100000:3.0:1788843211.106731:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 98 00000100:00100000:3.0:1788843211.106745:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+36:10523:x1875737775751552:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843211.106772:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843211.106800:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09153de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084991 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.106945:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b09153e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.106977:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b09153e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.106992:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b09153e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843211.107017:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788843211.107247:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09153de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084991 expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.107273:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b09153e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084991 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.107284:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab43e63000) 00010000:00010000:3.0:1788843211.107288:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843211.107293:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab41532e00, rc 0) 00000100:00100000:3.0:1788843211.107426:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+38:10523:x1875737775751552:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 683us (956us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788843211.107434:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 98 00000100:00100000:2.0:1788843211.115608:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843211.115813:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775751680 00000100:00100000:0.0:1788843211.115829:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775751680 00000100:00100000:2.0:1788843211.115909:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843211.116007:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:0.0:1788843211.116028:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+38:2359:x1875737775751680:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843211.116050:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843211.116084:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532e00/0xc6b8ac1b09153e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084991 expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.116109:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab43e63000) 00010000:00010000:0.0:1788843211.116116:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843211.116190:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+37:2359:x1875737775751680:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 172us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843211.116199:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:3.0:1788843211.116313:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775751936 00000100:00100000:3.0:1788843211.116319:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775751936 00000100:00100000:3.0:1788843211.116390:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 99 00000100:00100000:3.0:1788843211.116400:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+37:10523:x1875737775751936:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843211.116429:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843211.116450:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b09153f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084998 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.116598:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09153fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.116616:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09153fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.116627:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09153fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843211.116654:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788843211.118977:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab41532a00/0xc6b8ac1b09153f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084998 expref: 40 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.119011:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09153fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084998 expref: 39 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.119030:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab43e63000) 00010000:00010000:3.0:1788843211.119034:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788843211.119038:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82055e00, rc 0) 00000100:00100000:3.0:1788843211.119147:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+39:10523:x1875737775751936:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 2746us (3237us total) trans 4294967380 rc 0/0 00000100:00100000:3.0:1788843211.119158:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 99 00000100:00100000:0.0:1788843211.126030:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843211.126157:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775752064 00000100:00100000:1.0:1788843211.126182:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775752064 00000100:00080000:2.0:1788843211.126269:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843211.126288:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:1.0:1788843211.126303:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775752064:12345-192.168.203.29@tcp:1:lfs.0 00010000:00010000:1.0:1788843211.126597:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c400c919/0xc6b8ac1b0915408 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.126625:0:8216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000019a76543/0xc6b8ac1b09153c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084983 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.126636:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843211.126646:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843211.126651:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c400c919/0xc6b8ac1b0915408 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.126702:0:8216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000019a76543/0xc6b8ac1b09153c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084983 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.127034:0:8216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000019a76543/0xc6b8ac1b09153c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084983 expref: 6 pid: 6692 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843211.127056:0:8216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e77c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1875737795691904:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843211.128099:0:8216:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7793a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788843211.134641:0:8216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e77c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1875737795691904:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843211.134679:0:8216:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c400c919/0xc6b8ac1b0915408 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843211.137977:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843211.138045:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775752192 00000100:00100000:1.0:1788843211.138057:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775752192 00002000:00100000:1.0:1788843211.138132:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8dab6e77d500 x1875737775752192/t0(0) o4->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:582/0 lens 504/0 e 0 to 0 dl 1788843222 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788843211.138144:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab6e77d500 with x1875737775752192 ext(0->8) 00010000:00010000:1.0:1788843211.138155:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000019a76543/0xc6b8ac1b09153c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084983 expref: 7 pid: 6692 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.138187:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000019a76543/0xc6b8ac1b09153c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084983 expref: 7 pid: 6692 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788843211.138197:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8dab6e77d500 00000100:00100000:1.0:1788843211.138231:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:1.0:1788843211.138243:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2359:x1875737775752192:12345-192.168.203.29@tcp:4:lfs.0 00000100:00100000:1.0:1788843211.138986:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+9:2359:x1875737775752192:12345-192.168.203.29@tcp:4:lfs.0 Request processed in 738us (1018us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788843211.138997:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00002000:00100000:1.0:1788843211.139006:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8dab6e77d500 x1875737775752192/t4294967302(0) o4->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:582/0 lens 504/448 e 0 to 0 dl 1788843222 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788843211.139016:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab6e77d500 with x1875737775752192 ext(0->8) 00010000:00010000:1.0:1788843211.139037:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000019a76543/0xc6b8ac1b09153c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084983 expref: 9 pid: 6692 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.139053:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000019a76543/0xc6b8ac1b09153c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084983 expref: 9 pid: 6692 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788843211.139061:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8dab6e77d500 00000001:00080000:3.0:1788843211.143666:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:3.0:1788843211.144139:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1788843211.146866:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843211.147053:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775752320 00000100:00100000:0.0:1788843211.147068:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775752320 00010000:00010000:0.0:1788843211.147127:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000019a76543/0xc6b8ac1b09153c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084983 expref: 9 pid: 6692 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843211.147187:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:0.0:1788843211.147199:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+9:2359:x1875737775752320:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843211.147214:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788843211.147245:0:5831:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788843211.147248:0:5831:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788843211 00002000:00010000:0.0:1788843211.147251:0:5831:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788843211 00002000:00010000:0.0:1788843211.147253:0:5831:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788843211 00010000:00010000:0.0:1788843211.147260:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000019a76543/0xc6b8ac1b09153c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084983 expref: 9 pid: 6692 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.147275:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000019a76543/0xc6b8ac1b09153c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084983 expref: 9 pid: 6692 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.147303:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019a76543/0xc6b8ac1b09153c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084983 expref: 9 pid: 6692 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.147325:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788843211.147331:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788843211.147338:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c400c919/0xc6b8ac1b0915408 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.147413:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c400c919/0xc6b8ac1b0915408 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.147453:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843211.147648:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2359:x1875737775752320:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 450us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843211.147951:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 50 00010000:00010000:3.0:1788843211.148856:0:8216:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c400c919/0xc6b8ac1b0915408 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.148875:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c400c919/0xc6b8ac1b0915408 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.148932:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c400c919/0xc6b8ac1b0915408 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.148942:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c400c919/0xc6b8ac1b0915408 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.148953:0:8216:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c400c919/0xc6b8ac1b0915408 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.148960:0:8216:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b400 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843211.148965:0:8216:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c400c919/0xc6b8ac1b0915408 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.148975:0:8216:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c400c919/0xc6b8ac1b0915408 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.148992:0:8216:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c400c919/0xc6b8ac1b0915408 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.149000:0:8216:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c400c919/0xc6b8ac1b0915408 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843211.149110:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43783480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2358:x1875737775752064:12345-192.168.203.29@tcp:1:lfs.0 Request processed in 22806us (23102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843211.149120:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:2.0:1788843211.152907:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843211.153094:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775752576 00000100:00100000:0.0:1788843211.153110:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775752576 00000100:00100000:0.0:1788843211.153209:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:0.0:1788843211.153248:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6640c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+39:10523:x1875737775752576:12345-192.168.203.29@tcp:35:lfs.0 00000004:00010000:0.0:1788843211.153397:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09153fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084998 expref: 39 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843211.153831:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788843211.153887:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1788843211.155082:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:1.0:1788843211.155190:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b091540f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.155212:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09153b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084975 expref: 43 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.155236:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b091540f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.155277:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09153b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084975 expref: 43 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.155296:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09153b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084975 expref: 43 pid: 7168 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843211.155312:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e77d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1875737795692032:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843211.155532:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7793a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788843211.163003:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e77d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1875737795692032:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843211.163043:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b091540f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843211.166268:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843211.168740:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775752704 00000100:00100000:3.0:1788843211.168763:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775752704 00010000:00010000:3.0:1788843211.168904:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09153b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084975 expref: 44 pid: 7168 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843211.169047:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:3.0:1788843211.169071:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+44:2359:x1875737775752704:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843211.169095:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843211.169104:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09153b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084975 expref: 44 pid: 7168 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.169120:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09153b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084975 expref: 44 pid: 7168 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.169147:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054e00/0xc6b8ac1b09153b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084975 expref: 44 pid: 7168 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.169171:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab43e63000) 00010000:00010000:3.0:1788843211.169178:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b091540f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.169189:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b091540f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.169197:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b091540f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.169268:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843211.169404:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+43:2359:x1875737775752704:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 345us (3149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843211.169414:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 51 00010000:00010000:0.0:1788843211.169498:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b091540f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.169507:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b091540f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843211.169682:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:0.0:1788843211.169953:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788843211.170857:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43783100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1875737795692160:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788843211.171082:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843211.171190:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4a9b6300 going to sleep for 11 seconds 00000100:00100000:3.0:1788843211.171206:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795692160 00000100:00100000:3.0:1788843211.171216:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795692160 00000100:00100000:3.0:1788843211.171318:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843211.171329:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1875737795692160:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788843211.171498:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1875737795692160:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 169us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843211.171508:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788843211.171578:0:5849:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788843211.171585:0:5849:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1788843211.171616:0:5849:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dab600bdc00, transno 4294967301 00000100:00100000:0.0:1788843211.171683:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43783100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1875737795692160:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788843211.173008:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:0.0:1788843211.173215:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43783100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1875737795692288:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788843211.173300:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843211.173458:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa4112a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788843211.175533:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795692288 00000100:00100000:2.0:1788843211.175554:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795692288 00000100:00100000:2.0:1788843211.175636:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843211.175649:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1875737795692288:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788843211.176455:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5849:x1875737795692288:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 805us (3149us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788843211.176468:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788843211.177046:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43783100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1875737795692288:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788843211.177166:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788843211.177256:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b091540f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.177270:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b091540f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.177278:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b091540f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.177285:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933ae00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843211.177292:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b091540f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.177302:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b091540f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.177322:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab43e63000) 00010000:00010000:0.0:1788843211.177326:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788843211.177331:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b091540f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.177337:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b091540f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788843211.177618:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788843211.178019:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1788843211.178048:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 335428705826ns, next at 336428702256ns, rc = 0 00000001:00080000:0.0:1788843211.178059:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1788843211.178186:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab43e63000) 00010000:00010000:0.0:1788843211.178192:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788843211.178204:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055e00/0xc6b8ac1b09153fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084998 expref: 47 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843211.178781:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6640c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+46:10523:x1875737775752576:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 25533us (25891us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1788843211.178794:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 26 00000020:00080000:0.0:1788843211.178802:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788843211.183958:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843211.184085:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775752832 00000100:00100000:1.0:1788843211.184098:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775752832 00000100:00100000:1.0:1788843211.184179:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 100 00000100:00100000:1.0:1788843211.184189:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+46:10523:x1875737775752832:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1788843211.184219:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843211.184247:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915416 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c60708499f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.184330:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915416 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708499f expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.184387:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915416 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708499f expref: 47 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.184413:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:1.0:1788843211.184435:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843211.184441:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933a000, rc 0) 00000100:00100000:1.0:1788843211.184509:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+47:10523:x1875737775752832:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 321us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843211.184517:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 100 00000100:00100000:0.0:1788843211.191598:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843211.191720:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775753088 00000100:00100000:2.0:1788843211.191733:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775753088 00000100:00100000:2.0:1788843211.191910:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:2.0:1788843211.191922:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+47:10523:x1875737775753088:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1788843211.192249:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+48:10523:x1875737775753088:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 328us (664us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788843211.192276:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:2.0:1788843211.257251:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843211.257412:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775753216 00000100:00100000:3.0:1788843211.257426:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775753216 00000100:00100000:3.0:1788843211.257508:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 101 00000100:00100000:3.0:1788843211.257520:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+48:10533:x1875737775753216:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:3.0:1788843211.257638:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b091541d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.257776:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b091541d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.257861:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b091541d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.257883:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b0915424 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.257890:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b0915424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.257913:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b0915424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.258041:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b091542b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.258050:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b091542b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.258058:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b091542b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843211.258232:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b091542b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.258250:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b091541d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.258258:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b091541d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.258265:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b091541d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.258272:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799e800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843211.258277:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b091541d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.258285:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b091541d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.258303:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:3.0:1788843211.258315:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843211.258322:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b091541d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.258328:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b091541d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.258775:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b0915424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.259145:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b0915424 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.259156:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b0915424 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.259162:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799fa00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843211.259167:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b0915424 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.259175:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b0915424 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.259187:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab43e63d00) 00010000:00010000:3.0:1788843211.259190:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843211.259194:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b0915424 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.259201:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b0915424 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.259224:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b091542b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.259242:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b091542b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.259249:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b091542b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.259255:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799fc00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843211.259258:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b091542b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.259263:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b091542b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.259272:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:3.0:1788843211.259274:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843211.259277:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b091542b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.259283:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b091542b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843211.265389:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+48:10533:x1875737775753216:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 6806us (7089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843211.265418:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 101 00000100:00100000:3.0:1788843211.302493:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843211.302950:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775753472 00000100:00100000:2.0:1788843211.302964:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775753472 00000100:00100000:2.0:1788843211.303145:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 102 00000100:00100000:2.0:1788843211.303160:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+48:10536:x1875737775753472:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843211.303192:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843211.303225:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915432 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070849a6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.303381:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915439 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.303403:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915439 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.303419:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915439 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.303439:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915440 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.303448:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.303456:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.303612:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915447 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.303636:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.303644:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915447 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843211.303657:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788843211.304391:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915439 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.304404:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915439 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.304413:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915439 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.304421:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843211.304427:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915439 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.304436:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915439 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.304452:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:2.0:1788843211.304455:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843211.304461:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915439 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.304468:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915439 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.304486:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915440 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.304502:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915440 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.304508:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.304512:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843211.304515:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915440 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.304521:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915440 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.304529:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab54910e00) 00010000:00010000:2.0:1788843211.304532:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843211.304535:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915440 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.304540:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915440 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.304595:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915432 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849a6 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.304613:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849a6 expref: 50 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.304621:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:2.0:1788843211.304624:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843211.304633:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88200, rc 0) 00000100:00100000:2.0:1788843211.304745:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+50:10536:x1875737775753472:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1587us (2267us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788843211.305920:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 102 00000100:00100000:1.0:1788843211.310675:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843211.310778:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775753600 00000100:00100000:2.0:1788843211.310795:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775753600 00000100:00100000:2.0:1788843211.310884:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 103 00000100:00100000:2.0:1788843211.310897:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+50:10536:x1875737775753600:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:2.0:1788843211.310991:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915455 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.311034:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.311049:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.311085:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915455 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.311094:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915455 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.311102:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.311110:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff89800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843211.311116:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915455 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.311125:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915455 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.311163:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:2.0:1788843211.311167:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843211.311174:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915455 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.311186:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915455 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843211.311285:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+50:10536:x1875737775753600:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 391us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843211.311294:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 103 00000100:00100000:3.0:1788843211.313227:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843211.313892:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775753856 00000100:00100000:0.0:1788843211.313907:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775753856 00000100:00100000:0.0:1788843211.313980:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:0.0:1788843211.313994:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+50:10536:x1875737775753856:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:0.0:1788843211.314416:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+51:10536:x1875737775753856:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 423us (1199us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788843211.314426:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:3.0:1788843211.370622:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843211.370718:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775754112 00000100:00100000:1.0:1788843211.370731:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775754112 00000100:00100000:1.0:1788843211.370817:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 104 00000100:00100000:1.0:1788843211.370829:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+51:10546:x1875737775754112:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:1.0:1788843211.370861:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843211.370865:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788843211.370901:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09153d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708498a expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.370926:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:1.0:1788843211.370933:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843211.370949:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b091545c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070849ad expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.371102:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915463 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.371118:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915447 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849a6 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.371128:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915463 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.371196:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849a6 expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.371212:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915447 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849a6 expref: 51 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843211.371230:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e77c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1875737795692416:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843211.371406:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7793a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843211.379936:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843211.380554:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e77c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1875737795692416:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843211.380593:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915463 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843211.380688:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775754240 00000100:00100000:0.0:1788843211.380697:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775754240 00010000:00010000:0.0:1788843211.380747:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915447 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849a6 expref: 52 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843211.380795:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:0.0:1788843211.380806:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+52:2359:x1875737775754240:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843211.380826:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843211.380833:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915447 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849a6 expref: 52 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.380870:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915447 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849a6 expref: 52 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.380897:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b0915447 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849a6 expref: 52 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.380918:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:0.0:1788843211.380924:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915463 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.380936:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915463 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.380944:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915463 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.380987:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843211.381078:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+51:2359:x1875737775754240:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 272us (1157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843211.381086:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 52 00010000:00010000:3.0:1788843211.381217:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915463 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.381236:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915463 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843211.381262:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788843211.381498:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b091545c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849ad expref: 52 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.381520:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915463 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849ad expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.381530:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:3.0:1788843211.381534:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788843211.381536:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933ac00, rc 0) 00000100:00100000:3.0:1788843211.381568:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+51:10546:x1875737775754112:12345-192.168.203.29@tcp:101:bash.0 Request processed in 10743us (10964us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1788843211.381576:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 104 00000100:00100000:3.0:1788843211.386831:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843211.386919:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775754496 00000100:00100000:0.0:1788843211.386932:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775754496 00000100:00100000:0.0:1788843211.387035:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 105 00000100:00100000:0.0:1788843211.387048:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+51:10546:x1875737775754496:12345-192.168.203.29@tcp:36:bash.0 00010000:00010000:0.0:1788843211.387701:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915471 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.387727:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915471 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.387763:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915471 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843211.387832:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:0.0:1788843211.387861:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbcb3209 reply state 0000000007bc15e7 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915471 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843211.387872:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788843211.388052:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+54:10546:x1875737775754496:12345-192.168.203.29@tcp:36:bash.0 Request processed in 1003us (1237us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788843211.388062:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 105 00000020:00080000:0.0:1788843211.388068:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788843211.395324:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915471 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.395382:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915471 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.395391:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915471 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.395397:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843211.395402:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915471 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.395430:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915471 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.395461:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:3.0:1788843211.395464:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843211.395469:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915471 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.395476:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b0915471 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843211.395901:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843211.396097:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775754624 00000100:00100000:2.0:1788843211.396109:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775754624 00000100:00100000:2.0:1788843211.396179:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 106 00000100:00100000:2.0:1788843211.396192:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+53:10546:x1875737775754624:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1788843211.396225:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843211.396246:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915478 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070849b4 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.396403:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091547f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.396418:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915463 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849ad expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.396428:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091547f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.396483:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915463 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849ad expref: 54 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.396506:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915463 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849ad expref: 54 pid: 5848 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843211.396524:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c0a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1875737795692544:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843211.396635:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd180 going to sleep for 11 seconds 00000100:00100000:2.0:1788843211.399301:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c0a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1875737795692544:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843211.399377:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091547f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843211.400980:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843211.401100:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775754752 00000100:00100000:0.0:1788843211.401112:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775754752 00010000:00010000:0.0:1788843211.401166:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915463 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849ad expref: 55 pid: 5848 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843211.401216:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:0.0:1788843211.401228:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+55:2359:x1875737775754752:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843211.401246:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843211.401253:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915463 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849ad expref: 55 pid: 5848 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.401269:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915463 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849ad expref: 55 pid: 5848 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.401299:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915463 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849ad expref: 55 pid: 5848 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.401394:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:0.0:1788843211.401401:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091547f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.401413:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091547f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.401421:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091547f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.401658:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843211.401790:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091547f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.401800:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091547f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843211.401862:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788843211.401867:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843211.401892:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091547f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.401932:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915478 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849b4 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.401950:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091547f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849b4 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.401958:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:2.0:1788843211.401970:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843211.401975:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88a00, rc 0) 00000100:00100000:0.0:1788843211.402043:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+54:2359:x1875737775754752:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 815us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843211.402053:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:2.0:1788843211.402994:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+53:10546:x1875737775754624:12345-192.168.203.29@tcp:101:bash.0 Request processed in 6799us (7092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843211.403005:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 106 00000100:00100000:1.0:1788843211.406655:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843211.406748:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775755008 00000100:00100000:0.0:1788843211.406761:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775755008 00000100:00100000:0.0:1788843211.406902:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:0.0:1788843211.406914:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+53:10546:x1875737775755008:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:0.0:1788843211.407276:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+54:10546:x1875737775755008:12345-192.168.203.29@tcp:35:bash.0 Request processed in 362us (691us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1788843211.407285:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:1.0:1788843211.463073:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843211.463470:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775755136 00000100:00100000:2.0:1788843211.463484:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775755136 00000100:00100000:2.0:1788843211.463615:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 107 00000100:00100000:2.0:1788843211.463629:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+54:10552:x1875737775755136:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843211.463664:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843211.463691:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915486 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070849bb expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.463779:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b091548d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.463796:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b091548d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.463809:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b091548d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843211.463864:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788843211.463868:0:7168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843211.463890:0:7168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b091548d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.463919:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915486 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849bb expref: 56 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.463966:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b091548d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849bb expref: 55 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.463976:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:2.0:1788843211.463979:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843211.463983:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88e00, rc 0) 00000100:00100000:2.0:1788843211.464075:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+55:10552:x1875737775755136:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 450us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843211.464084:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 107 00000100:00100000:2.0:1788843211.468156:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843211.468309:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775755264 00000100:00100000:3.0:1788843211.468323:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775755264 00000100:00100000:3.0:1788843211.468459:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 108 00000100:00100000:3.0:1788843211.468472:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+55:10552:x1875737775755264:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843211.468502:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843211.468532:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b0915494 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070849c2 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.468636:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b091549b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.468655:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b091549b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.468668:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b091549b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.468711:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09154a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.468719:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09154a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.468726:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09154a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.468840:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b09154a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.468850:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b09154a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.468858:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b09154a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843211.468899:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788843211.468903:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788843211.468924:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b09154a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.468937:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b09154a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.468947:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b091549b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.468954:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b091549b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.468973:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b091549b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.468979:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799fa00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843211.468984:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b091549b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.468994:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b091549b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.469008:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:3.0:1788843211.469012:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843211.469018:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b091549b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.472063:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b091549b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.472104:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09154a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.472112:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09154a2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.472120:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09154a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.472127:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799e800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843211.472132:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09154a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.472209:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09154a2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.472232:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab43e63d00) 00010000:00010000:3.0:1788843211.472236:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843211.472242:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09154a2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.472247:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09154a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.472368:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b0915494 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c2 expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.472385:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b09154a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c2 expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.472393:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:3.0:1788843211.472754:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843211.472759:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799e600, rc 0) 00000100:00100000:3.0:1788843211.472929:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+56:10552:x1875737775755264:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 4459us (4790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843211.472936:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 108 00000100:00100000:1.0:1788843211.478536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843211.480105:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843211.480315:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775755648 00000100:00100000:2.0:1788843211.480329:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775755648 00000100:00100000:2.0:1788843211.480429:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 109 00000100:00100000:2.0:1788843211.480452:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+56:10552:x1875737775755648:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843211.480481:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843211.480627:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09154b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070849c9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.480778:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.480795:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091547f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849b4 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.480804:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b09154a9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c2 expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.480830:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.480863:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b09154a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c2 expref: 57 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.480877:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b09154a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c2 expref: 57 pid: 5848 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843211.480890:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c0a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795692672:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843211.480986:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091547f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849b4 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.480996:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091547f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849b4 expref: 57 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843211.481006:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c0a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795692800:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843211.481042:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843211.481524:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775755392 00000100:00100000:3.0:1788843211.481532:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775755392 00010000:00010000:3.0:1788843211.481562:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b09154a9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c2 expref: 58 pid: 5848 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843211.481621:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:3.0:1788843211.481629:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+58:2358:x1875737775755392:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843211.481640:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843211.481647:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b09154a9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c2 expref: 58 pid: 5848 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.481659:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b09154a9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c2 expref: 58 pid: 5848 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.481678:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:3.0:1788843211.481682:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.481758:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.481765:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843211.481810:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+58:2358:x1875737775755392:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 181us (3290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843211.481818:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 54 00010000:00010000:2.0:1788843211.487130:0:5846:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.29@tcp) returned -22 from blocking AST (req@000000007696da4b x1875737795692672) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b09154a9 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c2 expref: 57 pid: 5848 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.487159:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b09154a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c2 expref: 57 pid: 5848 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843211.487190:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c0a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795692672:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843211.487234:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c0a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795692800:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843211.487265:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:2.0:1788843211.487271:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.487280:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.487290:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843211.487691:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843211.491467:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775755776 00000100:00100000:2.0:1788843211.491483:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775755776 00010000:00010000:2.0:1788843211.491540:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091547f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849b4 expref: 57 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843211.491645:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:2.0:1788843211.491655:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51551c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+57:2359:x1875737775755776:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843211.491670:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843211.491677:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091547f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849b4 expref: 57 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.491691:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091547f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849b4 expref: 57 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.491712:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091547f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849b4 expref: 57 pid: 5847 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.491756:0:7638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:2.0:1788843211.491762:0:7638:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.491772:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.491780:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843211.491803:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843211.491879:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51551c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+56:2359:x1875737775755776:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 224us (4188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843211.491886:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 55 00010000:00010000:0.0:1788843211.492884:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.492905:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843211.492936:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788843211.494644:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09154b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c9 expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.494687:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c9 expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.494699:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:0.0:1788843211.494703:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788843211.494707:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89e00, rc 0) 00000100:00100000:0.0:1788843211.494817:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+56:10552:x1875737775755648:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 14366us (14721us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1788843211.494827:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 109 00000100:00100000:1.0:1788843211.501074:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843211.501156:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775756032 00000100:00100000:0.0:1788843211.501174:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775756032 00000100:00100000:0.0:1788843211.501277:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:0.0:1788843211.501290:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+56:10552:x1875737775756032:12345-192.168.203.29@tcp:103:lfs.0 00010000:00010000:0.0:1788843211.501323:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843211.501400:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915416 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708499f expref: 56 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843211.501429:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:0.0:1788843211.501436:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843211.501513:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+55:10552:x1875737775756032:12345-192.168.203.29@tcp:103:lfs.0 Request processed in 226us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843211.501521:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:1.0:1788843211.504825:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843211.505148:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775756160 00000100:00100000:3.0:1788843211.505158:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775756160 00000100:00100000:3.0:1788843211.505407:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 110 00000100:00100000:3.0:1788843211.505419:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+55:10552:x1875737775756160:12345-192.168.203.29@tcp:58:lfs.0 00010000:00010000:3.0:1788843211.505548:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b09154c5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.505584:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b09154c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843211.505596:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b09154c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788843211.505808:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788843211.505915:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+55:10552:x1875737775756160:12345-192.168.203.29@tcp:58:lfs.0 Request processed in 497us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843211.505925:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 110 00000100:00100000:3.0:1788843211.508724:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843211.509275:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775756288 00000100:00100000:1.0:1788843211.509285:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775756288 00000100:00100000:1.0:1788843211.509538:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 111 00000100:00100000:1.0:1788843211.509550:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+55:10552:x1875737775756288:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1788843211.509578:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843211.509600:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b09154cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070849d0 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.509662:0:7168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b09154c5 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.509691:0:7168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b09154cc lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849d0 expref: 56 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.509856:0:7168:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b09154c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.509873:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b09154cc lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849d0 expref: 56 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.509888:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:1.0:1788843211.510073:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843211.510079:0:7168:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b09154cc lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849d0 expref: 56 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843211.510089:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933ae00, rc 0) 00000100:00100000:1.0:1788843211.510156:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+56:10552:x1875737775756288:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 608us (1441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843211.510163:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 111 00010000:00010000:1.0:1788843211.524743:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843211.589036:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795692928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843211.589113:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843211.589315:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795692928 00000100:00100000:1.0:1788843211.589324:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795692928 00000100:00100000:1.0:1788843211.589474:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788843211.589484:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875737795692928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843211.589844:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843211.589907:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875737795692928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 424us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843211.589929:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788843211.590028:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795692928:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1788843212.036680:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788843212.036691:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843212.036761:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1788843212.036769:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788843212.036920:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875737795693056:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788843212.037060:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7793a180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843212.046516:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843212.048505:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775756416 00000100:00100000:2.0:1788843212.048526:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775756416 00000100:00100000:2.0:1788843212.048883:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 112 00000100:00100000:2.0:1788843212.048897:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab600bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+57:10553:x1875737775756416:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788843212.048963:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788843212.049125:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab600bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+57:10553:x1875737775756416:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 231us (2622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843212.049135:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 112 00000100:00100000:1.0:1788843212.049433:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc1f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875737795693056:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788843212.055441:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843212.056507:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775756544 00000100:00100000:0.0:1788843212.056521:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775756544 00000100:00100000:0.0:1788843212.058521:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 113 00000100:00100000:0.0:1788843212.058547:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+56:10553:x1875737775756544:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788843212.058703:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09154d3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.058726:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09154d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.058742:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09154d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.061632:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b09154da lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.061663:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b09154da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.061679:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b09154da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.061721:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09154e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.061733:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09154e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.061741:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09154e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843212.061821:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788843212.061828:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788843212.061850:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09154e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.061865:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09154d3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.061873:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09154d3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.061881:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09154d3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.061889:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843212.061894:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09154d3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.061904:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09154d3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.061921:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab61f39d00) 00010000:00010000:0.0:1788843212.061925:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843212.061931:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09154d3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.061939:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09154d3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.061959:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b09154da lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.061982:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b09154da lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.061990:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b09154da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.061998:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843212.062004:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b09154da lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.062013:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b09154da lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.062039:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8dab43ece800) 00010000:00010000:0.0:1788843212.062043:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843212.062047:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b09154da lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.062055:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4400/0xc6b8ac1b09154da lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.062085:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09154e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.062093:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09154e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.062100:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09154e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.062107:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843212.062125:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09154e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.062134:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09154e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.062147:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:0.0:1788843212.062151:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843212.062155:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09154e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.062163:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b09154e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843212.062290:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+56:10553:x1875737775756544:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 Request processed in 3749us (6858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843212.062303:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 113 00000100:00100000:3.0:1788843212.068945:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843212.069980:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775756800 00000100:00100000:0.0:1788843212.069992:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775756800 00000100:00100000:0.0:1788843212.070068:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 114 00000100:00100000:0.0:1788843212.070081:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+56:10553:x1875737775756800:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843212.070111:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843212.070137:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b09154e8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070849d7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.070242:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09154ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.070258:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09154ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.070288:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09154ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843212.070300:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788843212.072213:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09154ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.072229:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09154ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.072237:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09154ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.072244:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843212.072248:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09154ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.072256:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09154ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.072271:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:0.0:1788843212.072274:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788843212.072279:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09154ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.072285:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09154ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.072331:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b09154e8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849d7 expref: 58 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.073076:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab61f39d00) 00010000:00010000:0.0:1788843212.073079:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788843212.073087:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b09154e8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849d7 expref: 58 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.073099:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c5800, rc 0) 00000100:00100000:0.0:1788843212.073192:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+57:10553:x1875737775756800:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 3113us (4253us total) trans 4294967398 rc 301/301 00000100:00100000:0.0:1788843212.073202:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 114 00000100:00100000:3.0:1788843212.079262:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843212.079374:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775756928 00000100:00100000:1.0:1788843212.079383:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775756928 00000100:00100000:1.0:1788843212.079449:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 115 00000100:00100000:1.0:1788843212.079460:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+57:10553:x1875737775756928:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788843212.079496:0:7168:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788843212.079601:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+57:10553:x1875737775756928:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 143us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843212.079609:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 115 00000100:00100000:2.0:1788843212.087072:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843212.087172:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775757184 00000100:00100000:3.0:1788843212.087182:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775757184 00000100:00100000:3.0:1788843212.087244:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 116 00000100:00100000:3.0:1788843212.087255:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+57:10553:x1875737775757184:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843212.087275:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843212.087279:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788843212.087308:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b091548d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849bb expref: 57 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.087326:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:3.0:1788843212.087331:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843212.087404:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09154fd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070849de expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788843212.088312:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788843212.088829:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b0915504 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.088914:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b0915504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.088925:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b0915504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.088991:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09154fd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849de expref: 59 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.089010:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b0915504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849de expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.089203:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dab43e63d00) 00010000:00010000:3.0:1788843212.089207:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843212.089212:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799fa00, rc 0) 00000100:00100000:3.0:1788843212.089290:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+58:10553:x1875737775757184:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 2035us (2227us total) trans 4294967399 rc 0/0 00000100:00100000:3.0:1788843212.089298:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 116 00000100:00100000:3.0:1788843212.096047:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843212.096569:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775757440 00000100:00100000:1.0:1788843212.096579:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775757440 00000100:00100000:1.0:1788843212.096731:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 117 00000100:00100000:1.0:1788843212.096742:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+58:10553:x1875737775757440:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788843212.096802:0:7168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843212.096830:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b0915504 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849de expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.096850:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dab43e63d00) 00010000:00010000:1.0:1788843212.096864:0:7168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843212.096888:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915512 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.096902:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915512 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.096927:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915512 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.096991:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915519 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7ec27c10 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.096999:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915519 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ec27c10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.097007:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915519 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ec27c10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.097086:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915512 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.097093:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915512 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.097100:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915512 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.097106:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843212.097110:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915512 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.097117:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915512 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.097125:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:1.0:1788843212.097128:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843212.097132:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915512 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.097144:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b0915512 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.097155:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915519 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ec27c10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.097161:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915519 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ec27c10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.097167:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915519 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ec27c10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.097171:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933bc00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843212.097174:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915519 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ec27c10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.097179:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915519 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7ec27c10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.097186:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7ec27c10 (ffff8dab61f39500) 00010000:00010000:1.0:1788843212.097189:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843212.097191:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915519 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7ec27c10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.097196:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915519 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7ec27c10 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843212.097292:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+57:10553:x1875737775757440:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 551us (1256us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788843212.097299:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 117 00000100:00100000:1.0:1788843212.108997:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843212.109769:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775757568 00000100:00100000:0.0:1788843212.109780:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775757568 00000100:00100000:0.0:1788843212.109900:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 118 00000100:00100000:0.0:1788843212.109912:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+57:10553:x1875737775757568:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843212.109932:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843212.109956:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915520 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070849e5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.109990:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915527 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.110003:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.110025:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.110121:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915520 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849e5 expref: 59 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.110148:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849e5 expref: 58 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.110156:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dab43ece800) 00010000:00010000:0.0:1788843212.110159:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843212.110162:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4e00, rc 0) 00000100:00100000:0.0:1788843212.110235:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+58:10553:x1875737775757568:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 326us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843212.110243:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 118 00000100:00100000:2.0:1788843212.124776:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843212.126938:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775757824 00000100:00100000:1.0:1788843212.126953:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775757824 00000100:00100000:1.0:1788843212.127047:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 119 00000100:00100000:1.0:1788843212.127058:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+58:10553:x1875737775757824:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788843212.127144:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b091552e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.127168:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b091552e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.127180:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b091552e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788843212.127513:0:7168:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:1.0:1788843212.127526:0:7168:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336378183275ns, next at 337378180255ns, rc = 0 00000004:00010000:1.0:1788843212.127661:0:7168:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004dce4b90 reply state 00000000dd6c9a69 transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b091552e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843212.127671:0:7168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788843212.127778:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+60:10553:x1875737775757824:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 720us (3010us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788843212.127787:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 119 00010000:00010000:2.0:1788843212.134173:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b091552e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.134228:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b091552e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.134237:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b091552e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.134243:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843212.134248:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b091552e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.134256:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b091552e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.134275:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dab43ece800) 00010000:00010000:2.0:1788843212.134279:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788843212.134283:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b091552e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.134289:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b091552e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843212.138142:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843212.139320:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775757952 00000100:00100000:3.0:1788843212.139392:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775757952 00000100:00100000:3.0:1788843212.139499:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 120 00000100:00100000:3.0:1788843212.139516:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+59:10553:x1875737775757952:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843212.139570:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843212.139613:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915535 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070849ec expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.139707:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915535 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849ec expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.139729:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915535 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849ec expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.139763:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dab43ece800) 00010000:00010000:3.0:1788843212.139768:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843212.139774:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799e800, rc 0) 00000100:00100000:3.0:1788843212.139879:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+60:10553:x1875737775757952:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 364us (1743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843212.139892:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 120 00000100:00100000:1.0:1788843212.148831:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843212.148936:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775758080 00000100:00100000:0.0:1788843212.148946:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775758080 00000100:00100000:0.0:1788843212.149033:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:0.0:1788843212.149044:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2359:x1875737775758080:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788843212.149336:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+9:2359:x1875737775758080:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 294us (516us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788843212.149376:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00080000:2.0:1788843212.149566:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843212.154452:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843212.154581:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775758336 00000100:00100000:2.0:1788843212.154592:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775758336 00000100:00100000:2.0:1788843212.154670:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:2.0:1788843212.154687:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+60:10553:x1875737775758336:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788843212.154978:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+61:10553:x1875737775758336:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 294us (544us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788843212.155012:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:3.0:1788843212.160061:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843212.160202:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775758592 00000100:00100000:1.0:1788843212.160212:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775758592 00000100:00100000:1.0:1788843212.160274:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 121 00000100:00100000:1.0:1788843212.160286:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+61:10553:x1875737775758592:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788843212.160552:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+61:10553:x1875737775758592:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 267us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843212.160559:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 121 00000100:00100000:1.0:1788843212.163770:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843212.163857:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775758720 00000100:00100000:3.0:1788843212.163866:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775758720 00000100:00100000:3.0:1788843212.163927:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 122 00000100:00100000:3.0:1788843212.163938:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+61:10553:x1875737775758720:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843212.163957:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843212.163976:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b091553c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070849f3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.164098:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f000/0xc6b8ac1b0915543 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.164135:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f000/0xc6b8ac1b0915543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.164151:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f000/0xc6b8ac1b0915543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843212.164201:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788843212.164227:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f000/0xc6b8ac1b0915543 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.164265:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b091553c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849f3 expref: 63 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.164289:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f000/0xc6b8ac1b0915543 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849f3 expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.164301:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dab43ece800) 00010000:00010000:3.0:1788843212.164305:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788843212.164309:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799f000, rc 0) 00000100:00100000:3.0:1788843212.164474:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+62:10553:x1875737775758720:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 538us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843212.164482:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 122 00000100:00100000:3.0:1788843212.170063:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843212.173453:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775758848 00000100:00100000:0.0:1788843212.173474:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775758848 00000100:00100000:0.0:1788843212.173660:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 38 00000100:00100000:0.0:1788843212.173672:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+9:2359:x1875737775758848:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843212.173694:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843212.173715:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bbced6e/0xc6b8ac1b091554a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c6070849fa expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843212.173744:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f94cc, blocks: 0x1 00010000:00010000:0.0:1788843212.173781:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=336s v=(0 0) 00010000:00010000:0.0:1788843212.173786:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843212.173796:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bbced6e/0xc6b8ac1b091554a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849fa expref: 10 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.173815:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006bbced6e/0xc6b8ac1b091554a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849fa expref: 10 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.173828:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c5800, rc 0) 00000100:00100000:0.0:1788843212.173890:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+10:2359:x1875737775758848:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 220us (3836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843212.173897:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 38 00000100:00100000:2.0:1788843212.181300:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843212.181520:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775759104 00000100:00100000:1.0:1788843212.181530:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775759104 00000100:00100000:1.0:1788843212.181600:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 123 00000100:00100000:1.0:1788843212.181610:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+62:10553:x1875737775759104:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788843212.181710:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+62:10553:x1875737775759104:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 101us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843212.181718:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 123 00000100:00100000:1.0:1788843212.185284:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843212.185430:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775759232 00000100:00100000:0.0:1788843212.185441:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775759232 00000100:00100000:0.0:1788843212.185500:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:0.0:1788843212.185512:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+10:10553:x1875737775759232:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843212.185529:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843212.185547:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915551 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a01 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.185579:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006bbced6e/0xc6b8ac1b091554a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849fa expref: 11 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.185589:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843212.185593:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843212.185599:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915551 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a01 expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.185649:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006bbced6e/0xc6b8ac1b091554a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849fa expref: 11 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.185663:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006bbced6e/0xc6b8ac1b091554a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849fa expref: 11 pid: 6692 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843212.185678:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43782a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6694:1875737795693184:192.168.203.29@tcp:104: 00000100:00100000:0.0:1788843212.185778:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa4112ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843212.188989:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843212.189372:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775759360 00000100:00100000:1.0:1788843212.189382:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775759360 00010000:00010000:1.0:1788843212.189421:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006bbced6e/0xc6b8ac1b091554a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849fa expref: 12 pid: 6692 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843212.189466:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:1.0:1788843212.189476:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+12:2358:x1875737775759360:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843212.189494:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843212.189513:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006bbced6e/0xc6b8ac1b091554a lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849fa expref: 12 pid: 6692 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.189528:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006bbced6e/0xc6b8ac1b091554a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849fa expref: 12 pid: 6692 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.189573:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843212.189588:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843212.189596:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915551 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a01 expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.189607:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915551 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a01 expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.189646:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915551 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a01 expref: 12 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843212.189659:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73924e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1875737795693312:192.168.203.29@tcp:105: 00000100:00100000:1.0:1788843212.189755:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7793a300 going to sleep for 11 seconds 00010000:00010000:0.0:1788843212.189934:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bbced6e/0xc6b8ac1b091554a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849fa expref: 12 pid: 6692 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843212.189953:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43782a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6694:1875737795693184:192.168.203.29@tcp:104: 00010000:00010000:0.0:1788843212.189988:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915551 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a01 expref: 11 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.190000:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4a00, rc 0) 00000100:00100000:0.0:1788843212.190060:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+11:10553:x1875737775759232:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 4551us (4785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843212.190069:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:1.0:1788843212.193630:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73924e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5833:1875737795693312:192.168.203.29@tcp:105: 00010000:00010000:1.0:1788843212.193657:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843212.193722:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+10:2358:x1875737775759360:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 4245us (4740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843212.193734:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:3.0:1788843212.197189:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843212.197384:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775759488 00000100:00100000:1.0:1788843212.197394:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775759488 00002000:00100000:1.0:1788843212.197453:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8dab7766d500 x1875737775759488/t0(0) o4->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:583/0 lens 504/0 e 0 to 0 dl 1788843223 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788843212.197466:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab7766d500 with x1875737775759488 ext(0->12) 00002000:00010000:1.0:1788843212.197472:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dab7766d500 00000100:00100000:1.0:1788843212.197521:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:1.0:1788843212.197530:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+10:2358:x1875737775759488:12345-192.168.203.29@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788843212.198166:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+12:2358:x1875737775759488:12345-192.168.203.29@tcp:4:lhsmtool_posix.0 Request processed in 634us (984us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788843212.198176:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00002000:00100000:1.0:1788843212.198185:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8dab7766d500 x1875737775759488/t4294967308(0) o4->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:583/0 lens 504/448 e 0 to 0 dl 1788843223 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788843212.198195:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab7766d500 with x1875737775759488 ext(0->12) 00002000:00010000:1.0:1788843212.198200:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dab7766d500 00000100:00100000:3.0:1788843212.200785:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843212.201063:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775759616 00000100:00100000:2.0:1788843212.201077:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775759616 00000100:00100000:2.0:1788843212.201156:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 124 00000100:00100000:2.0:1788843212.201168:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+62:10553:x1875737775759616:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1788843212.237708:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+62:10553:x1875737775759616:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 Request processed in 36530us (36921us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843212.237720:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 124 00000100:00100000:2.0:1788843212.240304:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000001:00080000:0.0:1788843212.240469:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967398 is committed 00000004:00080000:0.0:1788843212.240497:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788843212.240522:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dab699169c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788843212.240527:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dab44011600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dab4556af00 00000020:00080000:0.0:1788843212.240543:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dab44011000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dab454ed800 00000001:00080000:0.0:1788843212.240587:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:0.0:1788843212.240591:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:0.0:1788843212.240604:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788843212.240611:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dab50c45240 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788843212.240614:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dab69893000 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dab50c45c00 00000020:00080000:0.0:1788843212.240617:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dab69893800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dab7c165400 00000001:00080000:0.0:1788843212.240632:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000020:00080000:2.0:1788843212.240937:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1788843212.241137:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1788843212.241222:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e77c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795693568:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788843212.241277:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843212.241316:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e77c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795693440:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788843212.241946:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795693696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788843212.242140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843212.242241:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775759744 00000100:00100000:3.0:1788843212.242250:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775759744 00000100:00100000:3.0:1788843212.242315:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795693568 00000100:00100000:3.0:1788843212.242319:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795693568 00000100:00100000:3.0:1788843212.242377:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:3.0:1788843212.242389:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+12:2358:x1875737775759744:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788843212.242516:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788843212.242527:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875737795693568:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788843212.242544:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1788843212.242569:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfbcb9cb/0xc6b8ac1b0915558 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.242608:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b091531a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084960 expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.242618:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788843212.242623:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843212.242628:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfbcb9cb/0xc6b8ac1b0915558 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.242664:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b091531a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.29@tcp remote: 0x34e059c607084960 expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.242692:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b091531a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.29@tcp remote: 0x34e059c607084960 expref: 12 pid: 6693 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843212.242706:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73924e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6693:1875737795693824:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843212.242774:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7793a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788843212.245119:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73924e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6693:1875737795693824:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843212.245150:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000bfbcb9cb/0xc6b8ac1b0915558 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788843212.245281:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843212.245299:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843212.245367:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1788843212.245375:0:6694:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:2.0:1788843212.245699:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795693440 00000100:00100000:2.0:1788843212.245707:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795693440 00000100:00100000:2.0:1788843212.245745:0:6694:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788843212.245751:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795693696 00000100:00100000:2.0:1788843212.245753:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795693696 00000100:00100000:1.0:1788843212.245911:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788843212.245922:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3305:x1875737795693440:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788843212.245952:0:12070:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1788843212.245985:0:12070:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f94cb, atime: 0x6a9f94cb, ctime: 0x6a9f94cb, blocks: 0x1 00010000:00010000:1.0:1788843212.245993:0:12070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b091555f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.246007:0:12070:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=336s v=(0 0) 00010000:00010000:1.0:1788843212.246012:0:12070:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843212.246032:0:12070:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b091555f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.246048:0:12070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b091555f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.246065:0:12070:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b091555f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.246074:0:12070:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b091555f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.246098:0:12070:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788843212.246771:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3305:x1875737795693440:12345-0@lo:6:osp-syn-1-0.0 Request processed in 848us (4628us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788843212.246779:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788843212.246802:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788843212.246809:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3307:x1875737795693696:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788843212.246905:0:12070:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788843212.246909:0:12070:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788843212 00002000:00010000:1.0:1788843212.246911:0:12070:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788843212.246914:0:12070:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788843212 -> 1788843212 00002000:00010000:1.0:1788843212.246916:0:12070:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788843212.246944:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3307:x1875737795693696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 136us (1646us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788843212.246949:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:2.0:1788843212.247190:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843212.247202:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b091555f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.247212:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b800 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843212.247226:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b091555f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.247237:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b091555f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.247260:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b091555f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.247267:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b091555f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.247289:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843212.247291:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843212.247292:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788843212.247332:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dab6e77c700/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788843212.247338:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e77c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795693440:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788843212.247400:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dab6e848000/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788843212.247405:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795693696:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788843212.256215:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843212.256295:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775759872 00000100:00100000:1.0:1788843212.256305:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775759872 00010000:00010000:1.0:1788843212.256370:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b091531a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.29@tcp remote: 0x34e059c607084960 expref: 13 pid: 6693 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843212.256726:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:2.0:1788843212.256738:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+13:2359:x1875737775759872:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843212.256754:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843212.256761:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b091531a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.29@tcp remote: 0x34e059c607084960 expref: 13 pid: 6693 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.256788:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b091531a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.29@tcp remote: 0x34e059c607084960 expref: 13 pid: 6693 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.256812:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b091531a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.29@tcp remote: 0x34e059c607084960 expref: 13 pid: 6693 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.256833:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788843212.256838:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788843212.256930:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000bfbcb9cb/0xc6b8ac1b0915558 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.256942:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfbcb9cb/0xc6b8ac1b0915558 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.256970:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843212.257042:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+12:2359:x1875737775759872:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 306us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843212.257050:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 57 00010000:00010000:3.0:1788843212.257720:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000bfbcb9cb/0xc6b8ac1b0915558 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.257734:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfbcb9cb/0xc6b8ac1b0915558 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.257743:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfbcb9cb/0xc6b8ac1b0915558 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.257750:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfbcb9cb/0xc6b8ac1b0915558 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.257774:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788843212.258405:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51457480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3306:x1875737795693568:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15876us (17122us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788843212.258414:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1788843212.258681:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843212.258690:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfbcb9cb/0xc6b8ac1b0915558 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.258701:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933ac00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843212.258706:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfbcb9cb/0xc6b8ac1b0915558 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.258717:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfbcb9cb/0xc6b8ac1b0915558 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.258735:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfbcb9cb/0xc6b8ac1b0915558 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.258744:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfbcb9cb/0xc6b8ac1b0915558 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.258767:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843212.258769:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843212.258771:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788843212.259470:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dab6e77c000/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788843212.259483:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e77c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795693568:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1788843212.281833:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1788843212.281863:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1788843212.281977:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1788843212.281984:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:2.0:1788843212.282169:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775759744:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 Request processed in 39774us (41867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843212.282181:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:3.0:1788843212.285656:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843212.285735:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775760128 00000100:00100000:1.0:1788843212.285745:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775760128 00000100:00100000:1.0:1788843212.285816:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 125 00000100:00100000:1.0:1788843212.285827:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+15:10553:x1875737775760128:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788843212.285901:0:7168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843212.285945:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f000/0xc6b8ac1b0915543 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849f3 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.285969:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dab43ece800) 00010000:00010000:1.0:1788843212.285975:0:7168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843212.286010:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915566 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.286037:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915566 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.286047:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915566 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843212.286319:0:7168:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fcde3cb reply state 00000000e9f88711 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915566 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843212.286330:0:7168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788843212.287079:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+16:10553:x1875737775760128:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 1250us (1500us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1788843212.287090:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 125 00010000:00010000:2.0:1788843212.291098:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915566 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.291129:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915566 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.291137:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915566 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.291144:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933ac00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843212.291149:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915566 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.291158:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915566 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.291175:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dab43ece800) 00010000:00010000:2.0:1788843212.291178:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843212.291184:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915566 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.291190:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b0915566 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843212.292197:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843212.292283:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775760256 00000100:00100000:2.0:1788843212.292294:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775760256 00000100:00100000:2.0:1788843212.292394:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:2.0:1788843212.292406:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2357:x1875737775760256:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788843212.292666:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1788843212.292670:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788843212 -> 1788843211 00002000:00010000:2.0:1788843212.292672:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788843211 00002000:00010000:2.0:1788843212.292674:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788843212 -> 1788843211 00002000:00010000:2.0:1788843212.292688:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788843212.292893:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2357:x1875737775760256:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 488us (706us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788843212.292902:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:3.0:1788843212.296181:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843212.296285:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775760512 00000100:00100000:0.0:1788843212.296296:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775760512 00000100:00100000:2.0:1788843212.296619:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 126 00000100:00100000:2.0:1788843212.296634:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+15:10553:x1875737775760512:12345-192.168.203.29@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788843212.296727:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091556d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.296753:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915527 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849e5 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.296765:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091556d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.296811:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849e5 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.296827:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915527 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849e5 expref: 15 pid: 5848 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843212.296842:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1875737795693952:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843212.296933:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab440d5300 going to sleep for 11 seconds 00000100:00100000:2.0:1788843212.300572:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1875737795693952:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843212.300604:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091556d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843212.302505:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843212.303083:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775760640 00000100:00100000:1.0:1788843212.303096:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775760640 00010000:00010000:1.0:1788843212.303151:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915527 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849e5 expref: 16 pid: 5848 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843212.303208:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00100000:1.0:1788843212.303218:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+16:2359:x1875737775760640:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843212.303236:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843212.303243:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915527 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849e5 expref: 16 pid: 5848 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.303272:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849e5 expref: 16 pid: 5848 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.303298:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915527 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849e5 expref: 16 pid: 5848 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.303316:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dab43ece800) 00010000:00010000:1.0:1788843212.303327:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091556d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.303337:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091556d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.303630:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091556d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.303663:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843212.303728:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+15:2359:x1875737775760640:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 510us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843212.303736:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 58 00010000:00010000:3.0:1788843212.307641:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091556d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.307659:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091556d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.307713:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091556d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.307721:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091556d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.307728:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091556d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.307734:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843212.307737:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091556d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.307745:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091556d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.307761:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dab43ece800) 00010000:00010000:3.0:1788843212.307764:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788843212.307769:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091556d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.307774:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b091556d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843212.307882:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+14:10553:x1875737775760512:12345-192.168.203.29@tcp:55:lhsmtool_posix.0 Request processed in 11247us (11711us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788843212.307892:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 126 00000100:00100000:3.0:1788843212.311396:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843212.311576:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775760768 00000100:00100000:0.0:1788843212.311587:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775760768 00000100:00100000:0.0:1788843212.311648:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:0.0:1788843212.311659:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2358:x1875737775760768:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788843212.311710:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0e5b038/0xc6b8ac1b0915574 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.311732:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915551 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a01 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.311756:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843212.311761:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788843212.311766:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e5b038/0xc6b8ac1b0915574 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.311809:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915551 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a01 expref: 7 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.311826:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915551 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a01 expref: 7 pid: 6694 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843212.311844:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43781500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1875737795694080:192.168.203.29@tcp:104: 00000100:00100000:0.0:1788843212.311948:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa4112ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843212.323744:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843212.324103:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43781500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1875737795694080:192.168.203.29@tcp:104: 00010000:00010000:0.0:1788843212.324136:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0e5b038/0xc6b8ac1b0915574 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843212.325775:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775760896 00000100:00100000:3.0:1788843212.325791:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775760896 00010000:00010000:3.0:1788843212.325858:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915551 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a01 expref: 8 pid: 6694 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843212.325962:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:3.0:1788843212.325973:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73924e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2358:x1875737775760896:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843212.325988:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843212.326010:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915551 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a01 expref: 8 pid: 6694 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.326038:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915551 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a01 expref: 8 pid: 6694 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.326061:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915551 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a01 expref: 8 pid: 6694 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.326077:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843212.326081:0:5833:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843212.326087:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0e5b038/0xc6b8ac1b0915574 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.326097:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e5b038/0xc6b8ac1b0915574 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843212.326130:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843212.326200:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73924e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2358:x1875737775760896:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 229us (2472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843212.326207:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 59 00010000:00010000:0.0:1788843212.326269:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0e5b038/0xc6b8ac1b0915574 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.326279:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0e5b038/0xc6b8ac1b0915574 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.326303:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000f0e5b038/0xc6b8ac1b0915574 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.326320:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0e5b038/0xc6b8ac1b0915574 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.326328:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0e5b038/0xc6b8ac1b0915574 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.326334:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5400 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843212.326359:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e5b038/0xc6b8ac1b0915574 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.326368:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0e5b038/0xc6b8ac1b0915574 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.326379:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0e5b038/0xc6b8ac1b0915574 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.326385:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0e5b038/0xc6b8ac1b0915574 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843212.326442:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775760768:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 Request processed in 14785us (15056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843212.326451:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:1.0:1788843212.331443:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843212.331544:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775761152 00000100:00100000:0.0:1788843212.331554:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775761152 00000100:00100000:0.0:1788843212.331636:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 127 00000100:00100000:0.0:1788843212.331670:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+14:10553:x1875737775761152:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788843212.331772:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091557b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.331794:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091557b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.331809:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091557b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.332032:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915582 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.332043:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915535 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849ec expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.332051:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915582 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.332085:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915535 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849ec expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.332098:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915535 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849ec expref: 15 pid: 5847 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843212.332112:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43781500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795694208:192.168.203.29@tcp:104: 00000100:00100000:0.0:1788843212.334177:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa4112ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843212.336168:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843212.336280:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43781500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795694208:192.168.203.29@tcp:104: 00010000:00010000:0.0:1788843212.336311:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915582 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843212.336470:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775761280 00000100:00100000:2.0:1788843212.336478:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775761280 00010000:00010000:2.0:1788843212.336514:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915535 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849ec expref: 16 pid: 5847 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843212.336552:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:2.0:1788843212.336561:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73925c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+16:2359:x1875737775761280:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843212.336577:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843212.336591:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915535 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849ec expref: 16 pid: 5847 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.336603:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915535 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849ec expref: 16 pid: 5847 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.336625:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915535 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849ec expref: 16 pid: 5847 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.336641:0:7638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dab43ece800) 00010000:00010000:2.0:1788843212.336646:0:7638:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915582 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.336656:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915582 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.336664:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915582 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.336851:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843212.336910:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73925c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+15:2359:x1875737775761280:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 348us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843212.336919:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 60 00010000:00010000:0.0:1788843212.337808:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915582 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.337824:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915582 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843212.338101:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788843212.338337:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788843212.338556:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788843212.338714:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43781500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1875737795694336:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788843212.338781:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843212.338825:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa4112a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788843212.339029:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795694336 00000100:00100000:3.0:1788843212.339039:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795694336 00000100:00100000:3.0:1788843212.339130:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788843212.339141:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1875737795694336:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788843212.340819:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1875737795694336:12345-0@lo:1000:mdt00_000.0 Request processed in 1668us (2026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843212.340836:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843212.340938:0:5846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1788843212.340945:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1788843212.340968:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dab6e848000, transno 4294967309 00000100:00100000:0.0:1788843212.341031:0:5846:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8dab6e77c000 x1875737795693568/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788843228 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843212.341046:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43781500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1875737795694336:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788843212.341814:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788843212.341907:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1875737795694464:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788843212.341959:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843212.341991:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa4112ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843212.342309:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795694464 00000100:00100000:3.0:1788843212.342315:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795694464 00000100:00100000:3.0:1788843212.342384:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788843212.342394:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1875737795694464:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788843212.342846:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5846:x1875737795694464:12345-0@lo:1000:mdt00_000.0 Request processed in 452us (884us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788843212.342854:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843212.342927:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1875737795694464:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788843212.342965:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915582 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.342976:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915582 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.342995:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915582 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.343002:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843212.343006:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915582 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.343027:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915582 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.343044:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dab43ece800) 00010000:00010000:1.0:1788843212.343047:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843212.343053:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915582 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.343060:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915582 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.343091:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b09154c5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.343098:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b09154c5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.343104:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b09154c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.343109:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799fc00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843212.343112:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b09154c5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.343132:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b09154c5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.343141:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:1.0:1788843212.343144:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843212.343151:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b09154cc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849d0 expref: 18 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.343162:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b09154cc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849d0 expref: 18 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.343172:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b09154cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849d0 expref: 18 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843212.345950:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b09154cc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849d0 expref: 18 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843212.345978:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73924380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795694592:192.168.203.29@tcp:105: 00000100:00100000:1.0:1788843212.346083:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7793ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843212.350870:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843212.351023:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775761408 00000100:00100000:2.0:1788843212.351033:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775761408 00000100:00100000:2.0:1788843212.351097:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:2.0:1788843212.351109:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+19:10552:x1875737775761408:12345-192.168.203.29@tcp:49:lfs.0 00000100:00100000:2.0:1788843212.351274:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+19:10552:x1875737775761408:12345-192.168.203.29@tcp:49:lfs.0 Request processed in 166us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843212.351282:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:0.0:1788843212.351660:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73924380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795694592:192.168.203.29@tcp:105: 00010000:00010000:0.0:1788843212.351690:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b09154c5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.351702:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b09154c5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.351750:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915589 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.351766:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915589 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.351777:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915589 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.351786:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915589 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.351793:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915589 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.351799:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915589 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.351805:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843212.351808:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915589 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.351816:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915589 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.351828:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:0.0:1788843212.351832:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843212.351836:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915589 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.351841:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915589 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.351859:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091557b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.351865:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091557b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.351870:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091557b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.351875:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843212.351877:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091557b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.351883:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091557b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.351891:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:0.0:1788843212.351893:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843212.351895:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091557b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.351900:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b091557b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843212.352149:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+18:10553:x1875737775761152:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 20481us (20730us total) trans 4294967407 rc 0/0 00000100:00100000:0.0:1788843212.352158:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 127 00000020:00080000:0.0:1788843212.352163:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788843212.352480:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788843212.352486:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788843212.352988:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788843212.353000:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788843212.356398:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843212.356594:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775761664 00000100:00100000:3.0:1788843212.356603:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775761664 00000100:00100000:3.0:1788843212.356674:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 128 00000100:00100000:3.0:1788843212.356685:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+18:10552:x1875737775761664:12345-192.168.203.29@tcp:58:lfs.0 00000040:00080000:3.0:1788843212.357010:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1788843212.357110:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+18:10552:x1875737775761664:12345-192.168.203.29@tcp:58:lfs.0 Request processed in 426us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843212.357117:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 128 00000100:00100000:1.0:1788843212.358757:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843212.358865:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775761920 00000100:00100000:2.0:1788843212.358878:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775761920 00000100:00100000:2.0:1788843212.358972:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:2.0:1788843212.358983:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6640e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+18:10553:x1875737775761920:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788843212.359865:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788843212.359969:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:2.0:1788843212.360030:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915590 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.360048:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.360058:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.360072:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915590 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.360078:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915590 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.360084:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915590 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.360120:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788843212.360293:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6640e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+20:10553:x1875737775761920:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 1308us (1542us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788843212.360304:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 32 00000020:00080000:2.0:1788843212.360311:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788843212.360446:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843212.360454:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915590 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.360469:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88e00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843212.360473:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915590 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.360482:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915590 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.360497:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:0.0:1788843212.360500:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788843212.360505:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915590 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.360510:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915590 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.360528:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843212.360530:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843212.360532:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843212.391256:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843212.391503:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775762048 00000100:00100000:2.0:1788843212.391514:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775762048 00000100:00100000:2.0:1788843212.391578:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 129 00000100:00100000:2.0:1788843212.391589:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+20:10555:x1875737775762048:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843212.391617:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843212.391638:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915597 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a08 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.391702:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b091559e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.391717:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b091559e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.391729:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b091559e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.391761:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b09155a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.391769:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b09155a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.391775:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b09155a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.392051:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09155ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.392063:0:7168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c9 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.392072:0:7168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09155ac lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.392122:0:7168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c9 expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.392137:0:7168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c9 expref: 21 pid: 5846 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843212.392152:0:7168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7168:1875737795694720:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843212.392272:0:7168:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab440d56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843212.397969:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843212.398032:0:7168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7168:1875737795694720:192.168.203.29@tcp:104: 00000100:00100000:3.0:1788843212.398069:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775762304 00010000:00010000:2.0:1788843212.398070:0:7168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09155ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843212.398086:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775762304 00000100:00100000:3.0:1788843212.398249:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:3.0:1788843212.398264:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+22:5596:x1875737775762304:12345-192.168.203.29@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788843212.400469:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+23:5596:x1875737775762304:12345-192.168.203.29@tcp:35:ldlm_bl.0 Request processed in 2194us (2497us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1788843212.400483:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:1.0:1788843212.407585:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843212.408517:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775762432 00000100:00100000:0.0:1788843212.408534:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775762432 00010000:00010000:0.0:1788843212.408604:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c9 expref: 23 pid: 5846 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843212.408678:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:0.0:1788843212.408690:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4886f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+23:2358:x1875737775762432:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843212.408706:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843212.408714:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c9 expref: 23 pid: 5846 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.408761:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c9 expref: 23 pid: 5846 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.408786:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09154b7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c6070849c9 expref: 23 pid: 5846 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.408807:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:0.0:1788843212.408813:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09155ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.408824:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09155ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.408831:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09155ac lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843212.408870:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843212.408917:0:7168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09155ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.408928:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09155ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843212.408957:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4886f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+22:2358:x1875737775762432:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 268us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843212.408966:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 61 00000004:00200000:2.0:1788843212.408985:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788843212.408993:0:7168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843212.409028:0:7168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09155ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.409044:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09155ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.409056:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b091559e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.409064:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b091559e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.409070:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b091559e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.409078:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff89800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843212.409084:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b091559e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.409093:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b091559e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.409114:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:2.0:1788843212.409118:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843212.409123:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b091559e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.409129:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b091559e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.409142:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b09155a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.409148:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b09155a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.409154:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b09155a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.409162:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843212.409166:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b09155a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.409172:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b09155a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.409182:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dab54910c00) 00010000:00010000:2.0:1788843212.409185:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843212.409188:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b09155a5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.409211:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b09155a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.409264:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915597 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a08 expref: 22 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.409278:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09155ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a08 expref: 21 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843212.409286:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:2.0:1788843212.409288:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843212.409291:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88200, rc 0) 00000100:00100000:2.0:1788843212.409338:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+21:10555:x1875737775762048:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 17751us (18093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843212.409403:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 129 00010000:00010000:1.0:1788843212.548773:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788843213.089241:0:12108:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788843213.089252:0:12108:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843213.089300:0:12108:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788843213.089315:0:12108:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1788843213.380616:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788843213.380625:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788843213.380680:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788843213.380686:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788843213.380815:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875737795694848:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788843213.380929:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab44fe86c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843213.386889:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875737795694848:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788843213.388071:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843213.388691:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775762560 00000100:00100000:3.0:1788843213.388719:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775762560 00000100:00100000:3.0:1788843213.388797:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 130 00000100:00100000:3.0:1788843213.388807:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+21:10567:x1875737775762560:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788843213.388846:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788843213.388962:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+21:10567:x1875737775762560:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 155us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843213.388970:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 130 00000100:00080000:2.0:1788843213.389080:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843213.394044:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843213.394946:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775762816 00000100:00100000:0.0:1788843213.394959:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775762816 00000100:00100000:0.0:1788843213.395044:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 131 00000100:00100000:0.0:1788843213.395055:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+21:10567:x1875737775762816:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843213.395079:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843213.395157:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09155b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a0f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843213.395316:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09155ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843213.395331:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09155ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843213.395369:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09155ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843213.395384:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788843213.395666:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09155b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a0f expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843213.395683:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09155ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a0f expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843213.395693:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:0.0:1788843213.395696:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843213.395700:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c5400, rc 0) 00000100:00100000:0.0:1788843213.395769:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+23:10567:x1875737775762816:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 716us (1732us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788843213.395777:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 131 00000100:00100000:1.0:1788843213.401908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843213.402198:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843213.402279:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775763200 00000100:00100000:0.0:1788843213.402288:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775763200 00000100:00100000:0.0:1788843213.402394:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 132 00000100:00100000:0.0:1788843213.402407:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+23:10567:x1875737775763200:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788843213.402508:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09155c8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843213.402536:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09155c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843213.402551:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09155c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843213.402815:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09155c8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843213.402823:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09155c8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843213.402830:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09155c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843213.402836:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843213.402840:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09155c8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843213.402848:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09155c8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843213.402862:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:0.0:1788843213.402865:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843213.402871:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09155c8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843213.402877:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09155c8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843213.403041:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+24:10567:x1875737775763200:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 636us (842us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788843213.403056:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 132 00000100:00100000:3.0:1788843213.407614:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775762944 00000100:00100000:3.0:1788843213.407629:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775762944 00000100:00100000:3.0:1788843213.407702:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:3.0:1788843213.407714:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+24:2358:x1875737775762944:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843213.407730:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843213.407755:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09155ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a0f expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843213.407777:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:3.0:1788843213.407783:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843213.407838:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+23:2358:x1875737775762944:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 126us (5941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843213.407845:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000040:00080000:1.0:1788843213.408529:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788843213.408535:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843213.409177:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1788843213.409190:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788843213.412096:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843213.412180:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775763456 00000100:00100000:0.0:1788843213.412190:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775763456 00000100:00100000:0.0:1788843213.412248:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:0.0:1788843213.412259:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+23:10567:x1875737775763456:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788843213.412540:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+24:10567:x1875737775763456:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 281us (460us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788843213.412548:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 34 00010000:00010000:2.0:1788843213.572536:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843214.596806:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788843214.810186:0:12159:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788843214.810194:0:12159:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788843214.810238:0:12159:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788843214.810244:0:12159:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788843214.996710:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843214.996750:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843214.996777:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843214.996805:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843214.996822:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843214.996847:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775763840 00000100:00100000:1.0:1788843214.996854:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775763840 00000100:00100000:1.0:1788843214.996895:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775763968 00000100:00100000:1.0:1788843214.996897:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775763968 00000100:00100000:1.0:1788843214.996915:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 77 00000100:00100000:1.0:1788843214.996925:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775763840:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843214.996991:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775763840:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 68us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843214.997011:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 77 00000100:00100000:1.0:1788843214.997030:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 78 00000100:00100000:1.0:1788843214.997036:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2358:x1875737775763968:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843214.997066:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2358:x1875737775763968:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 31us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843214.997086:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 78 00000100:00100000:0.0:1788843214.997221:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775764096 00000100:00100000:0.0:1788843214.997226:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775764096 00000100:00100000:0.0:1788843214.997268:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775763712 00000100:00100000:0.0:1788843214.997271:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775763712 00000100:00100000:0.0:1788843214.997293:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 135 00000100:00100000:0.0:1788843214.997300:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2358:x1875737775764096:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843214.997329:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2358:x1875737775764096:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 30us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843214.997335:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 135 00000100:00100000:0.0:1788843214.997380:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 136 00000100:00100000:0.0:1788843214.997386:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+24:2358:x1875737775763712:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843214.997413:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+24:2358:x1875737775763712:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 28us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843214.997551:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 136 00000100:00100000:3.0:1788843214.997646:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775763584 00000100:00100000:3.0:1788843214.997650:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775763584 00000100:00100000:3.0:1788843214.997682:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 284 00000100:00100000:3.0:1788843214.997694:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2358:x1875737775763584:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843214.997717:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2358:x1875737775763584:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 24us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843214.997722:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 284 00000100:00080000:2.0:1788843214.997804:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843214.997809:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788843214.997811:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843215.017567:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843215.019173:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775764352 00000100:00100000:1.0:1788843215.019188:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775764352 00000100:00100000:1.0:1788843215.019660:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 133 00000100:00100000:1.0:1788843215.019671:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+24:10588:x1875737775764352:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1788843215.019690:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843215.019711:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b09155cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a16 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843215.019811:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b09155d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843215.019826:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b09155d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843215.019839:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b09155d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843215.019849:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788843215.019978:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b09155cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a16 expref: 27 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843215.020010:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b09155d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a16 expref: 26 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843215.020019:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:1.0:1788843215.020022:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788843215.020026:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b200, rc 0) 00000100:00100000:1.0:1788843215.020141:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+26:10588:x1875737775764352:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 471us (2583us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1788843215.020148:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 133 00000100:00080000:2.0:1788843215.020657:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843215.028803:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843215.029814:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775764480 00000100:00100000:1.0:1788843215.029829:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775764480 00000100:00100000:1.0:1788843215.029921:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 134 00000100:00100000:1.0:1788843215.029932:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+26:10588:x1875737775764480:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:1.0:1788843215.030030:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b09155e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843215.030111:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b09155e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843215.030125:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b09155e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843215.030154:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b09155e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843215.030161:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b09155e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843215.030168:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b09155e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843215.030175:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933bc00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843215.030179:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b09155e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843215.030186:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b09155e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843215.030216:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:1.0:1788843215.030220:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788843215.030225:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b09155e4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843215.030231:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b09155e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843215.030443:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+26:10588:x1875737775764480:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 509us (1646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843215.030451:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 134 00000100:00100000:3.0:1788843215.108656:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843215.110135:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775764608 00000100:00100000:0.0:1788843215.110153:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775764608 00000100:00100000:0.0:1788843215.110388:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:0.0:1788843215.110503:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2359:x1875737775764608:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:0.0:1788843215.110523:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843215.110548:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000081bee96/0xc6b8ac1b09155eb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a1d expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843215.110583:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f94cb, atime: 0x6a9f94cb, ctime: 0x6a9f94cb, blocks: 0xb 00010000:00010000:0.0:1788843215.110608:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=339s v=(0 0) 00010000:00010000:0.0:1788843215.110613:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843215.110625:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000081bee96/0xc6b8ac1b09155eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a1d expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843215.110647:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000081bee96/0xc6b8ac1b09155eb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a1d expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843215.110673:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4400, rc 0) 00000100:00100000:0.0:1788843215.110817:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2359:x1875737775764608:12345-192.168.203.29@tcp:101:cat.0 Request processed in 316us (2174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843215.110824:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:0.0:1788843215.119671:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843215.119767:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775764736 00000100:00100000:1.0:1788843215.119776:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775764736 00002000:00100000:1.0:1788843215.119821:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8dab7ffc0e00 x1875737775764736/t0(0) o3->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:586/0 lens 488/0 e 0 to 0 dl 1788843226 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788843215.119834:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab7ffc0e00 with x1875737775764736 ext(0->4095) 00002000:00010000:1.0:1788843215.119839:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dab7ffc0e00 00000100:00100000:1.0:1788843215.119871:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:1.0:1788843215.119880:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2356:x1875737775764736:12345-192.168.203.29@tcp:3:cat.0 00000100:00100000:1.0:1788843215.120106:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2356:x1875737775764736:12345-192.168.203.29@tcp:3:cat.0 Request processed in 225us (444us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1788843215.120114:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00002000:00100000:1.0:1788843215.120120:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8dab7ffc0e00 x1875737775764736/t0(0) o3->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:586/0 lens 488/4536 e 0 to 0 dl 1788843226 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788843215.120128:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab7ffc0e00 with x1875737775764736 ext(0->4095) 00002000:00010000:1.0:1788843215.120148:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dab7ffc0e00 00000100:00100000:1.0:1788843215.173736:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7766ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795694976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843215.173813:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843215.174254:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795694976 00000100:00100000:0.0:1788843215.174263:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795694976 00000100:00100000:0.0:1788843215.174326:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788843215.174334:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875737795694976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843215.174397:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788843215.174469:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843215.174654:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7766ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795694976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843215.174711:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1875737795694976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 377us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843215.174737:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:0.0:1788843215.621061:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843216.199937:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7769f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795695488:0@lo:400:kworker.0 00000100:00100000:2.0:1788843216.200647:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843216.200723:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788843216.200732:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795695104:0@lo:400:kworker.0 00000100:00100000:2.0:1788843216.200766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843216.200792:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7769d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795695616:0@lo:400:kworker.0 00000100:00100000:2.0:1788843216.200818:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843216.200847:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795695232:0@lo:400:kworker.0 00000100:00100000:2.0:1788843216.200870:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843216.200893:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7769ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795695744:0@lo:400:kworker.0 00000100:00100000:2.0:1788843216.200915:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843216.200934:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843216.200939:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795695360:0@lo:400:kworker.0 00000100:00100000:2.0:1788843216.200956:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843216.201005:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795695616 00000100:00100000:2.0:1788843216.201013:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795695616 00000100:00100000:2.0:1788843216.201069:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795695232 00000100:00100000:2.0:1788843216.201072:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795695232 00000100:00100000:2.0:1788843216.201084:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795695360 00000100:00100000:2.0:1788843216.201086:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795695360 00000100:00100000:2.0:1788843216.201103:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788843216.201110:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875737795695616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843216.201169:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875737795695616:12345-0@lo:400:kworker.0 Request processed in 58us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843216.201185:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788843216.201203:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788843216.201208:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795695232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843216.201245:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795695232:12345-0@lo:400:kworker.0 Request processed in 37us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843216.201251:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788843216.201261:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788843216.201267:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795695360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843216.201291:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795695360:12345-0@lo:400:kworker.0 Request processed in 24us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843216.201297:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788843216.201318:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795695488 00000100:00100000:2.0:1788843216.201322:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795695488 00000100:00100000:2.0:1788843216.201362:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795695744 00000100:00100000:2.0:1788843216.201373:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795695744 00000100:00100000:2.0:1788843216.201397:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788843216.201404:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1875737795695488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843216.201435:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1875737795695488:12345-0@lo:400:kworker.0 Request processed in 32us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843216.201441:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788843216.201452:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788843216.201457:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1875737795695744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843216.201491:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3306:x1875737795695744:12345-0@lo:400:kworker.0 Request processed in 35us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843216.201497:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788843216.201524:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788843216.201528:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843216.201565:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e848000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795695360:0@lo:400:kworker.0 00000100:00100000:2.0:1788843216.201576:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795695232:0@lo:400:kworker.0 00000100:00100000:2.0:1788843216.201587:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7769ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795695744:0@lo:400:kworker.0 00000100:00100000:2.0:1788843216.201627:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7769d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795695616:0@lo:400:kworker.0 00000100:00100000:2.0:1788843216.201636:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7769f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795695488:0@lo:400:kworker.0 00000100:00100000:3.0:1788843216.202130:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795695104 00000100:00100000:3.0:1788843216.202135:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795695104 00000100:00100000:3.0:1788843216.202166:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788843216.202172:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3304:x1875737795695104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843216.202220:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3304:x1875737795695104:12345-0@lo:400:kworker.0 Request processed in 49us (1454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843216.202226:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788843216.205057:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795695104:0@lo:400:kworker.0 00000001:00080000:1.0:1788843216.247460:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:1.0:1788843216.247477:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:1.0:1788843216.644529:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843216.709266:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ce73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795695872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843216.709371:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843216.709447:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795695872 00000100:00100000:0.0:1788843216.709456:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795695872 00000100:00100000:0.0:1788843216.709508:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788843216.709518:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795695872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843216.709572:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843216.709621:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795695872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843216.709628:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788843216.709667:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788843216.709674:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788843216.709694:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dab6e77c700, transno 4294967304 00000100:00100000:0.0:1788843216.709711:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ce73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795695872:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788843217.266509:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788843217.266532:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8daa4112a300 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788843217.266538:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dab44011800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8daa4112a3c0 00000020:00080000:0.0:1788843217.266541:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dab44011200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dab454a0000 00000020:00080000:2.0:1788843217.266652:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:2.0:1788843217.266838:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:0.0:1788843217.266865:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1788843217.266882:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:3.0:1788843217.670410:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788843217.798871:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1788843217.798885:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:2.0:1788843218.692852:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843219.609829:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843219.612814:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775764864 00000100:00100000:3.0:1788843219.612835:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775764864 00000100:00100000:3.0:1788843219.612993:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 135 00000100:00100000:3.0:1788843219.613008:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+13:10232:x1875737775764864:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788843219.613176:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+13:10232:x1875737775764864:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 Request processed in 171us (3364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843219.613185:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 135 00000100:00100000:3.0:1788843219.618394:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843219.618464:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775765120 00000100:00100000:3.0:1788843219.618477:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775765120 00000100:00100000:3.0:1788843219.618545:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:3.0:1788843219.618557:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+13:10232:x1875737775765120:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788843219.621711:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+14:10232:x1875737775765120:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 3140us (3317us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788843219.621732:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00080000:0.0:1788843219.622729:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788843219.716648:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843219.946645:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843219.950588:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775765248 00000100:00100000:2.0:1788843219.950608:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775765248 00000100:00100000:2.0:1788843219.950800:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 136 00000100:00100000:2.0:1788843219.950811:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:11041:x1875737775765248:12345-192.168.203.29@tcp:101:lsof.0 00010000:00010000:2.0:1788843219.950831:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843219.950861:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09155f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a24 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843219.950926:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09155f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843219.950941:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09155f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843219.950953:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09155f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843219.951027:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788843219.951031:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843219.951362:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09155f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843219.951402:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b09155f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a24 expref: 7 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843219.951508:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09155f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a24 expref: 6 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843219.951517:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43ece400) 00010000:00010000:2.0:1788843219.951520:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843219.951524:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89e00, rc 0) 00000100:00100000:2.0:1788843219.951631:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:11041:x1875737775765248:12345-192.168.203.29@tcp:101:lsof.0 Request processed in 821us (4994us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843219.951639:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 136 00000100:00080000:0.0:1788843219.953662:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843220.115471:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843220.115514:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843220.115615:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775765376 00000100:00100000:0.0:1788843220.115652:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775765376 00000100:00100000:0.0:1788843220.115708:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 286 00000100:00100000:0.0:1788843220.115718:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2358:x1875737775765376:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843220.115786:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2358:x1875737775765376:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 69us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843220.115794:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 286 00000100:00100000:2.0:1788843220.115981:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843220.116014:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843220.116035:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843220.116092:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775765888 00000100:00100000:3.0:1788843220.116097:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775765888 00000100:00100000:3.0:1788843220.116127:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775765504 00000100:00100000:3.0:1788843220.116130:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775765504 00000100:00100000:3.0:1788843220.116148:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 140 00000100:00100000:3.0:1788843220.116155:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:2358:x1875737775765888:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843220.116194:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:2358:x1875737775765888:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 39us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843220.116201:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 140 00000100:00100000:3.0:1788843220.116213:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 141 00000100:00100000:3.0:1788843220.116219:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+14:2358:x1875737775765504:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843220.116247:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+14:2358:x1875737775765504:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 29us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843220.116253:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 141 00000100:00100000:1.0:1788843220.119969:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775765632 00000100:00100000:1.0:1788843220.119988:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775765632 00000100:00100000:3.0:1788843220.120079:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775765760 00000100:00100000:3.0:1788843220.120085:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775765760 00000100:00080000:2.0:1788843220.120213:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843220.120387:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00100000:3.0:1788843220.120408:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2358:x1875737775765760:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843220.120528:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2358:x1875737775765760:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 123us (4491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843220.120536:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00080000:2.0:1788843220.121175:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843220.121621:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 82 00000100:00100000:1.0:1788843220.121646:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775765632:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843220.121717:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775765632:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 86us (6202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843220.121725:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 82 00000100:00100000:2.0:1788843220.292993:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843220.293018:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795696000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843220.293089:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843220.293635:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795696000 00000100:00100000:0.0:1788843220.293644:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795696000 00000100:00100000:0.0:1788843220.293711:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788843220.293720:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795696000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843220.293756:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843220.293817:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795696000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843220.293824:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788843220.293886:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843220.294020:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788843220.294027:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dab6e77c000, transno 4294967310 00000004:00080000:3.0:1788843220.294045:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788843220.294076:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795696000:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788843220.741065:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843221.326723:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795696384:0@lo:400:kworker.0 00000100:00100000:0.0:1788843221.326792:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843221.326859:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788843221.326866:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795696256:0@lo:400:kworker.0 00000100:00100000:0.0:1788843221.326890:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843221.326914:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795696768:0@lo:400:kworker.0 00000100:00100000:0.0:1788843221.326937:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843221.326986:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795696768 00000100:00100000:0.0:1788843221.326993:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795696768 00000100:00100000:0.0:1788843221.327047:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788843221.327057:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795696768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843221.327131:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795696768:12345-0@lo:400:kworker.0 Request processed in 75us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843221.327144:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788843221.327177:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795696384 00000100:00100000:0.0:1788843221.327181:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795696384 00000100:00100000:0.0:1788843221.327211:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795696256 00000100:00100000:0.0:1788843221.327214:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795696256 00000100:00100000:0.0:1788843221.327232:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788843221.327239:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795696384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843221.327270:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795696384:12345-0@lo:400:kworker.0 Request processed in 32us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843221.327276:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788843221.327288:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788843221.327294:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795696256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843221.327320:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795696256:12345-0@lo:400:kworker.0 Request processed in 27us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843221.327326:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788843221.327685:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795696256:0@lo:400:kworker.0 00000100:00100000:1.0:1788843221.327697:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43782300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795696768:0@lo:400:kworker.0 00000100:00100000:1.0:1788843221.327705:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73925c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795696384:0@lo:400:kworker.0 00000100:00100000:3.0:1788843221.327972:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795696128:0@lo:400:kworker.0 00000100:00100000:3.0:1788843221.328014:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843221.328046:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795696640:0@lo:400:kworker.0 00000100:00100000:3.0:1788843221.328071:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843221.328090:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843221.328096:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795696512:0@lo:400:kworker.0 00000100:00100000:3.0:1788843221.328118:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843221.328144:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795696128 00000100:00100000:3.0:1788843221.328157:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795696128 00000100:00100000:3.0:1788843221.328188:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788843221.328195:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3305:x1875737795696128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843221.328235:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3305:x1875737795696128:12345-0@lo:400:kworker.0 Request processed in 41us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843221.328242:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788843221.328268:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795696512 00000100:00100000:3.0:1788843221.328272:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795696512 00000100:00100000:3.0:1788843221.328292:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788843221.328298:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795696512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843221.328376:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec4ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795696512:12345-0@lo:400:kworker.0 Request processed in 66us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843221.328382:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788843221.328411:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795696512:0@lo:400:kworker.0 00000100:00100000:3.0:1788843221.328420:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795696128:0@lo:400:kworker.0 00000100:00080000:2.0:1788843221.328612:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843221.328617:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843221.329326:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795696640 00000100:00100000:0.0:1788843221.329335:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795696640 00000100:00100000:0.0:1788843221.329433:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788843221.329442:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795696640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843221.329517:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795696640:12345-0@lo:400:kworker.0 Request processed in 76us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843221.329525:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788843221.329571:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43783100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795696640:0@lo:400:kworker.0 00000100:00080000:3.0:1788843221.330653:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788843221.639269:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788843221.639278:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788843221.639582:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1788843221.639590:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788843221.764794:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843221.833610:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ce70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795696896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843221.833717:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843221.833887:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795696896 00000100:00100000:1.0:1788843221.833895:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795696896 00000100:00100000:1.0:1788843221.833958:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788843221.833968:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795696896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843221.834004:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843221.834055:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795696896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843221.834071:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788843221.834130:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ce70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795696896:0@lo:13:osp-pre-1-0.0 00000020:00080000:3.0:1788843222.402082:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:3.0:1788843222.402115:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1788843222.402510:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1788843222.402529:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788843222.795694:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843223.812554:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788843224.029645:0:12362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 00:53:42 (1788843222) 00010000:00010000:0.0:1788843224.836999:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843225.236132:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843225.236183:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843225.236223:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843225.236258:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843225.236289:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843225.236330:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775766528 00000100:00100000:2.0:1788843225.236602:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775766144 00000100:00100000:2.0:1788843225.236610:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775766144 00000100:00100000:2.0:1788843225.236696:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 145 00000100:00100000:2.0:1788843225.236709:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+13:2359:x1875737775766144:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843225.236808:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+13:2359:x1875737775766144:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 102us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843225.236818:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 145 00000100:00080000:2.0:1788843225.236843:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843225.236952:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775766272 00000100:00100000:0.0:1788843225.236958:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775766272 00000100:00100000:3.0:1788843225.237043:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775766016 00000100:00100000:3.0:1788843225.237049:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775766016 00000100:00100000:3.0:1788843225.237083:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 288 00000100:00100000:3.0:1788843225.237090:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2359:x1875737775766016:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843225.237126:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2359:x1875737775766016:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 37us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843225.237133:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 288 00000100:00080000:2.0:1788843225.239689:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843225.240693:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775766528 00000100:00100000:1.0:1788843225.240819:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 146 00000100:00100000:1.0:1788843225.240832:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:2359:x1875737775766528:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843225.240953:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:2359:x1875737775766528:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 124us (4729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843225.240962:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 146 00000100:00080000:2.0:1788843225.241090:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843225.241916:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775766400 00000100:00100000:3.0:1788843225.241942:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775766400 00000100:00100000:3.0:1788843225.242017:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:3.0:1788843225.242030:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2359:x1875737775766272:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843225.242137:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2359:x1875737775766272:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 109us (5953us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843225.242145:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:3.0:1788843225.242164:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 86 00000100:00100000:3.0:1788843225.242171:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775766400:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843225.242218:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775766400:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 48us (5929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843225.242226:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 86 00000100:00100000:3.0:1788843225.242300:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00080000:1.0:1788843225.242888:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843225.242917:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775766784 00000100:00100000:1.0:1788843225.242936:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775766784 00000100:00100000:1.0:1788843225.242997:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 137 00000100:00100000:1.0:1788843225.243009:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+13:11308:x1875737775766784:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788843225.243034:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843225.243068:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915600 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a2b expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.243176:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915607 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.243196:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915607 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.243224:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915607 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.245743:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091560e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.245774:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091560e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.245788:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091560e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.246112:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915615 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.246123:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915615 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.246130:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915615 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843225.246142:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788843225.246289:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915607 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.246298:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915607 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.246305:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915607 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.246311:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933a000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843225.248606:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915607 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.249599:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915607 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.249622:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dab43e63a00) 00010000:00010000:1.0:1788843225.249625:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843225.249632:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915607 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.249820:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915607 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.249843:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091560e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.249849:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091560e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.249856:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091560e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.249862:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843225.249865:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091560e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.249871:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091560e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.249879:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8dab61f39400) 00010000:00010000:1.0:1788843225.249881:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843225.249884:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091560e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.249907:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b091560e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.254073:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915600 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a2b expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.254119:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915615 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a2b expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843225.254131:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab61f39d00) 00010000:00010000:1.0:1788843225.254134:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843225.254138:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b800, rc 0) 00000100:00100000:1.0:1788843225.256388:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+15:11308:x1875737775766784:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 13360us (14066us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788843225.256401:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 137 00000100:00100000:0.0:1788843225.264794:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843225.264874:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775767040 00000100:00100000:1.0:1788843225.264883:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775767040 00000100:00100000:1.0:1788843225.264957:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 138 00000100:00100000:1.0:1788843225.264967:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+15:11308:x1875737775767040:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788843225.265079:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+15:11308:x1875737775767040:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 Request processed in 113us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843225.265086:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 138 00000100:00100000:2.0:1788843225.268585:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843225.268748:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775766912 00000100:00100000:0.0:1788843225.268758:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775766912 00000100:00100000:0.0:1788843225.268857:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:0.0:1788843225.268868:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+15:2357:x1875737775766912:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843225.268885:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843225.268909:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915615 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a2b expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843225.268940:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab61f39d00) 00010000:00010000:0.0:1788843225.268947:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843225.269016:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+14:2357:x1875737775766912:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 149us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843225.269024:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:0.0:1788843225.418187:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843225.418209:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6eb28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795697024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843225.418278:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843225.418490:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795697024 00000100:00100000:1.0:1788843225.418499:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795697024 00000100:00100000:1.0:1788843225.418564:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788843225.418573:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795697024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843225.418620:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843225.418669:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795697024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843225.418677:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788843225.418727:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6eb28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795697024:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788843225.418919:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788843225.733074:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788843225.733107:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788843225.733160:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:2.0:1788843225.733168:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788843225.860588:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843226.452155:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795697280:0@lo:400:kworker.0 00000100:00100000:3.0:1788843226.452223:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843226.452271:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795697792:0@lo:400:kworker.0 00000100:00100000:3.0:1788843226.452294:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843226.452326:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843226.452332:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795697408:0@lo:400:kworker.0 00000100:00100000:3.0:1788843226.452543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843226.452573:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795697280 00000100:00100000:3.0:1788843226.452580:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795697280 00000100:00100000:3.0:1788843226.452622:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795697408 00000100:00100000:3.0:1788843226.452625:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795697408 00000100:00100000:3.0:1788843226.452656:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788843226.452666:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795697280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843226.452804:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6ec49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795697152:0@lo:400:kworker.0 00000100:00100000:1.0:1788843226.452824:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e77b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795697536:0@lo:400:kworker.0 00000100:00100000:2.0:1788843226.460149:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843226.460216:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795697664:0@lo:400:kworker.0 00000100:00100000:2.0:1788843226.460253:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843226.460288:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795697152 00000100:00100000:2.0:1788843226.460296:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795697152 00000100:00100000:2.0:1788843226.460338:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788843226.460377:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3305:x1875737795697152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843226.460428:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3305:x1875737795697152:12345-0@lo:400:kworker.0 Request processed in 53us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843226.460435:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788843226.460481:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec49500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795697152:0@lo:400:kworker.0 00000100:00100000:2.0:1788843226.461434:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795697664 00000100:00100000:2.0:1788843226.461442:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795697664 00000100:00100000:2.0:1788843226.461476:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788843226.461496:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795697408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843226.461558:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795697408:12345-0@lo:400:kworker.0 Request processed in 75us (9015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843226.461565:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788843226.461580:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788843226.461586:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795697664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843226.461623:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875737795697664:12345-0@lo:400:kworker.0 Request processed in 37us (1368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843226.461642:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00080000:2.0:1788843226.461660:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843226.461672:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795697792 00000100:00100000:2.0:1788843226.461676:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795697792 00000100:00100000:2.0:1788843226.461708:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788843226.461715:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795697792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843226.461749:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795697792:12345-0@lo:400:kworker.0 Request processed in 35us (9454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843226.461754:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:2.0:1788843226.461768:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843226.461792:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e778380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795697664:0@lo:400:kworker.0 00000100:00100000:1.0:1788843226.465522:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843226.465871:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795697536 00000100:00100000:0.0:1788843226.465880:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795697536 00000100:00100000:0.0:1788843226.465932:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788843226.465942:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795697536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843226.466015:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795697536:12345-0@lo:400:kworker.0 Request processed in 74us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843226.466035:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788843226.466496:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795697408:0@lo:400:kworker.0 00000100:00100000:2.0:1788843226.466513:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6ec4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795697280:0@lo:400:kworker.0 00000100:00100000:2.0:1788843226.466525:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e778700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795697792:0@lo:400:kworker.0 00000100:00100000:1.0:1788843226.467080:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e77b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795697536:0@lo:400:kworker.0 00000100:00100000:3.0:1788843226.479846:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e779c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795697280:12345-0@lo:400:kworker.0 Request processed in 27171us (27613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843226.479863:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00010000:00010000:2.0:1788843226.890310:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843226.957002:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6eb28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795697920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843226.957080:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843226.958492:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795697920 00000100:00100000:0.0:1788843226.958502:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795697920 00000100:00100000:0.0:1788843226.958556:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788843226.958566:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795697920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843226.958603:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843226.961234:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795697920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2541us (4025us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843226.961249:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788843226.961677:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6eb28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795697920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843227.419690:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843227.419763:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775767168 00000100:00100000:1.0:1788843227.419781:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775767168 00000100:00100000:1.0:1788843227.419845:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 139 00000100:00100000:1.0:1788843227.419855:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+14:11350:x1875737775767168:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1788843227.419872:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843227.419901:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915623 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a32 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.419971:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b091562a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.419986:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b091562a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.419997:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b091562a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420010:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915631 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420035:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915631 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420041:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915631 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420250:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b091562a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420259:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b091562a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420265:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b091562a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420272:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933ac00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843227.420276:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b091562a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420284:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b091562a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420296:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43ece400) 00010000:00010000:1.0:1788843227.420299:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843227.420303:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b091562a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420310:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b091562a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420321:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915631 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420332:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915631 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420338:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915631 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420369:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933a000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843227.420372:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915631 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420379:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915631 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420387:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8dab61f39400) 00010000:00010000:1.0:1788843227.420390:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843227.420393:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915631 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420399:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915631 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420428:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915623 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a32 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420437:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43ece400) 00010000:00010000:1.0:1788843227.420440:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843227.420444:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915623 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a32 expref: 15 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.420453:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b000, rc 0) 00000100:00100000:1.0:1788843227.420509:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+14:11350:x1875737775767168:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 655us (828us total) trans 0 rc 301/301 00000100:00100000:1.0:1788843227.420516:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 139 00000100:00080000:3.0:1788843227.420672:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843227.435413:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843227.435503:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775767424 00000100:00100000:1.0:1788843227.435513:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775767424 00000100:00100000:1.0:1788843227.435572:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 140 00000100:00100000:1.0:1788843227.435582:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+14:11350:x1875737775767424:12345-192.168.203.29@tcp:36:lfs.0 00010000:00010000:1.0:1788843227.435631:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843227.435658:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0914fa1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708486b expref: 14 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.435678:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43ece400) 00010000:00010000:1.0:1788843227.435683:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843227.435872:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915638 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.435886:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09155f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a24 expref: 5 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.435894:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915638 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.435940:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09155f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a24 expref: 5 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.435956:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09155f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a24 expref: 5 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843227.435971:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ce70700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795698048:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843227.436079:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4936a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843227.441648:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ce70700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795698048:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843227.441660:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00010000:00010000:3.0:1788843227.441682:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915638 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843227.442155:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775767552 00000100:00100000:0.0:1788843227.442162:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775767552 00010000:00010000:0.0:1788843227.442207:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09155f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a24 expref: 6 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843227.442244:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:0.0:1788843227.442255:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:2359:x1875737775767552:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843227.442269:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843227.442275:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09155f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a24 expref: 6 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843227.442287:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09155f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a24 expref: 6 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843227.442309:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b09155f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a24 expref: 6 pid: 5847 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843227.442358:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43ece400) 00010000:00010000:0.0:1788843227.442364:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915638 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843227.442373:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915638 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843227.442380:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915638 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843227.442400:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843227.442447:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775767552:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 193us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843227.442454:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00080000:3.0:1788843227.442807:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788843227.442826:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915638 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.442833:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915638 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.442857:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b091563f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.442867:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b091563f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.442875:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b091563f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843227.443844:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788843227.443856:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915638 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.443863:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915638 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.443871:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915638 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.443877:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933be00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843227.443881:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915638 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.443890:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915638 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.443909:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab43ece400) 00010000:00010000:3.0:1788843227.443923:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843227.443928:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915638 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.443934:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915638 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843227.443952:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2b2b27c reply state 00000000585dc31d transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b091563f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843227.443960:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788843227.444030:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+15:11350:x1875737775767424:12345-192.168.203.29@tcp:36:lfs.0 Request processed in 8447us (8624us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1788843227.444038:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 140 00010000:00010000:3.0:1788843227.447488:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b091563f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.447505:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b091563f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.447512:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b091563f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.447518:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799f800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843227.447523:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b091563f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.447531:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b091563f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.447559:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8dab43e63200) 00010000:00010000:3.0:1788843227.447563:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843227.447569:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b091563f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.447576:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b091563f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788843227.516952:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000001:00080000:3.0:1788843227.516975:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000100:00100000:0.0:1788843227.535797:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843227.535873:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775767680 00000100:00100000:1.0:1788843227.535881:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775767680 00000100:00100000:1.0:1788843227.536050:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 141 00000100:00100000:1.0:1788843227.536060:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+12:11358:x1875737775767680:12345-192.168.203.29@tcp:101:lctl.0 00010000:00010000:1.0:1788843227.536082:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843227.536102:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915646 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a39 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.536159:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b091564d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.536173:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b091564d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.536183:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b091564d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843227.536213:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788843227.536217:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788843227.536236:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b091564d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.536256:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915646 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a39 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.536274:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b091564d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a39 expref: 13 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.536298:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab61f39400) 00010000:00010000:1.0:1788843227.536301:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788843227.536304:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933ac00, rc 0) 00000100:00100000:1.0:1788843227.536535:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+13:11358:x1875737775767680:12345-192.168.203.29@tcp:101:lctl.0 Request processed in 474us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843227.536542:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 141 00000100:00100000:1.0:1788843227.627430:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843227.627495:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775767808 00000100:00100000:2.0:1788843227.627505:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775767808 00000100:00100000:2.0:1788843227.627567:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 142 00000100:00100000:2.0:1788843227.627576:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+13:11364:x1875737775767808:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1788843227.627594:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843227.627613:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915654 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a40 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.627690:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b091565b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.627713:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b091565b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.627725:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b091565b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.627739:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915662 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.627746:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.627752:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628155:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915669 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628164:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628172:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843227.628196:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788843227.628199:0:7168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843227.628215:0:7168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628235:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b091565b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628242:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b091565b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628248:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b091565b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628254:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff89e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843227.628258:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b091565b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628266:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b091565b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628277:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab61f39400) 00010000:00010000:2.0:1788843227.628280:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843227.628285:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b091565b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628290:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b091565b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628311:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915662 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628318:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915662 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628323:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628333:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843227.628336:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915662 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628384:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915662 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628393:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8dab54910600) 00010000:00010000:2.0:1788843227.628395:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843227.628398:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915662 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628404:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88a00/0xc6b8ac1b0915662 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628435:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89800/0xc6b8ac1b0915654 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a40 expref: 15 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628448:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915669 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a40 expref: 14 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.628455:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843227.628457:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788843227.628459:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff88e00, rc 0) 00000100:00100000:2.0:1788843227.628519:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+14:11364:x1875737775767808:12345-192.168.203.29@tcp:101:bash.0 Request processed in 944us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843227.628527:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 142 00000100:00100000:0.0:1788843227.633079:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843227.635319:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775768064 00000100:00100000:2.0:1788843227.635366:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775768064 00000100:00100000:2.0:1788843227.635438:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 143 00000100:00100000:2.0:1788843227.639970:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+14:11364:x1875737775768064:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1788843227.639998:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843227.640335:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0915670 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a47 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.640675:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375000/0xc6b8ac1b0915677 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.640693:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375000/0xc6b8ac1b0915677 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.640705:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375000/0xc6b8ac1b0915677 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.640776:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b091567e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.640784:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b091567e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.640790:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b091567e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788843227.641518:0:5847:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1788843227.641784:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915685 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.641796:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.641817:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915685 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.641851:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375000/0xc6b8ac1b0915677 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.641859:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375000/0xc6b8ac1b0915677 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.641866:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375000/0xc6b8ac1b0915677 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.641872:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843227.641876:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375000/0xc6b8ac1b0915677 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.641884:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375000/0xc6b8ac1b0915677 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.641896:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843227.641899:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843227.641904:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375000/0xc6b8ac1b0915677 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.641923:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375000/0xc6b8ac1b0915677 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843227.641947:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbf4b1d4 reply state 0000000085b211f1 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b091567e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843227.641955:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788843227.641997:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89e00/0xc6b8ac1b0915670 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a47 expref: 17 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.642014:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a47 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.642022:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910200) 00010000:00010000:2.0:1788843227.642024:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843227.642027:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374e00, rc 0) 00000100:00100000:2.0:1788843227.642103:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+17:11364:x1875737775768064:12345-192.168.203.29@tcp:101:bash.0 Request processed in 6656us (9032us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788843227.642111:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 143 00010000:00010000:2.0:1788843227.644733:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b091567e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.644750:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b091567e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.644759:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b091567e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.644765:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843227.644770:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b091567e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.644778:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b091567e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.644794:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab54910300) 00010000:00010000:2.0:1788843227.644866:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843227.644883:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b091567e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.644890:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b091567e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843227.645542:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843227.645635:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775768192 00000100:00100000:1.0:1788843227.645643:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775768192 00000100:00100000:1.0:1788843227.646254:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:1.0:1788843227.646267:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775768192:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:1.0:1788843227.646282:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843227.646300:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b0915693 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a4e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788843227.646323:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788843227.646370:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=351s v=(0 0) 00010000:00010000:1.0:1788843227.646375:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843227.646384:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b0915693 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a4e expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.646401:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b0915693 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a4e expref: 6 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.646414:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b800, rc 0) 00000100:00100000:1.0:1788843227.646486:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2359:x1875737775768192:12345-192.168.203.29@tcp:101:bash.0 Request processed in 222us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843227.646494:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00080000:3.0:1788843227.646544:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843227.649304:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843227.649531:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775768320 00000100:00100000:3.0:1788843227.649540:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775768320 00000100:00100000:3.0:1788843227.649589:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:3.0:1788843227.649599:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:11364:x1875737775768320:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1788843227.649617:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843227.649634:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f7b738d0/0xc6b8ac1b091569a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a55 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.649663:0:8216:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b0915693 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a4e expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.649672:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843227.649676:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843227.649680:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b738d0/0xc6b8ac1b091569a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a55 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.649710:0:8216:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b0915693 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a4e expref: 7 pid: 6694 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.649735:0:8216:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b0915693 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a4e expref: 7 pid: 6694 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843227.649748:0:8216:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e779500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1875737795698176:192.168.203.29@tcp:104: 00000100:00100000:3.0:1788843227.649843:0:8216:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab61fd1900 going to sleep for 11 seconds 00000100:00100000:3.0:1788843227.652502:0:8216:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e779500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8216:1875737795698176:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843227.652536:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f7b738d0/0xc6b8ac1b091569a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a55 expref: 7 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.652557:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799f800, rc 0) 00000100:00100000:3.0:1788843227.652610:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+7:11364:x1875737775768320:12345-192.168.203.29@tcp:101:bash.0 Request processed in 3012us (3314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843227.652619:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:1.0:1788843227.655054:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843227.656563:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775768448 00000100:00100000:2.0:1788843227.656578:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775768448 00010000:00010000:2.0:1788843227.656632:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b0915693 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a4e expref: 7 pid: 6694 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843227.656740:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:2.0:1788843227.656752:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2358:x1875737775768448:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843227.656770:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843227.656805:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b0915693 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a4e expref: 7 pid: 6694 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.656819:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b0915693 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a4e expref: 7 pid: 6694 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.656851:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003510d40e/0xc6b8ac1b0915693 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a4e expref: 7 pid: 6694 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.656869:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843227.656873:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843227.656881:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7b738d0/0xc6b8ac1b091569a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a55 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.656920:0:7638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b738d0/0xc6b8ac1b091569a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a55 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.656959:0:7638:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f7b738d0/0xc6b8ac1b091569a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a55 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843227.656974:0:7638:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7769ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7638:1875737795698304:192.168.203.29@tcp:105: 00000100:00100000:2.0:1788843227.657308:0:7638:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab436f1540 going to sleep for 11 seconds 00000100:00100000:2.0:1788843227.660171:0:7638:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7769ca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:7638:1875737795698304:192.168.203.29@tcp:105: 00010000:00010000:2.0:1788843227.660194:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843227.660248:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775768448:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 3499us (5205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843227.660259:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:0.0:1788843227.663883:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843227.663971:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775768704 00000100:00100000:3.0:1788843227.663981:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775768704 00000100:00100000:3.0:1788843227.664033:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:3.0:1788843227.664042:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+16:11364:x1875737775768704:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:3.0:1788843227.664399:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+17:11364:x1875737775768704:12345-192.168.203.29@tcp:35:bash.0 Request processed in 353us (519us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788843227.664408:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:1.0:1788843227.735997:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843227.736090:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775768960 00000100:00100000:3.0:1788843227.736099:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775768960 00000100:00100000:3.0:1788843227.736162:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 144 00000100:00100000:3.0:1788843227.736172:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+17:11374:x1875737775768960:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843227.736209:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843227.736238:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09156a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a5c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843227.736338:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788843227.736503:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09156a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a5c expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.736518:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab61f39400) 00010000:00010000:3.0:1788843227.736522:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843227.736527:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09156a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a5c expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.736542:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799e000, rc 0) 00000100:00100000:3.0:1788843227.736601:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+18:11374:x1875737775768960:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 430us (613us total) trans 4294967420 rc 301/301 00000100:00100000:3.0:1788843227.736608:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 144 00000100:00100000:0.0:1788843227.742437:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843227.744195:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775769216 00000100:00100000:3.0:1788843227.744208:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775769216 00000100:00100000:3.0:1788843227.744278:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:3.0:1788843227.744287:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+18:11374:x1875737775769216:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:3.0:1788843227.744630:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+19:11374:x1875737775769216:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 343us (2200us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1788843227.744639:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:0.0:1788843227.859614:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843227.859702:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775769344 00000100:00100000:1.0:1788843227.859711:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775769344 00000100:00100000:1.0:1788843227.859768:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 145 00000100:00100000:1.0:1788843227.859785:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+19:11380:x1875737775769344:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1788843227.859808:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843227.859827:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b09156af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a63 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.859888:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b09156b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.859901:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b09156b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.859923:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b09156b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843227.859958:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788843227.859962:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788843227.859978:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b09156b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.860007:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b09156af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a63 expref: 21 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.860051:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b09156b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a63 expref: 20 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.860061:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:1.0:1788843227.860064:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788843227.860067:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933be00, rc 0) 00000100:00100000:1.0:1788843227.860120:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+20:11380:x1875737775769344:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 344us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843227.860128:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 145 00000100:00100000:1.0:1788843227.868780:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843227.868851:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775769600 00000100:00100000:3.0:1788843227.868860:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775769600 00000100:00100000:3.0:1788843227.868925:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 146 00000100:00100000:3.0:1788843227.868949:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+20:11380:x1875737775769600:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843227.868970:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843227.868988:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09156bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a6a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.869078:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ee00/0xc6b8ac1b09156c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.869093:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ee00/0xc6b8ac1b09156c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.869103:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ee00/0xc6b8ac1b09156c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843227.869115:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788843227.869225:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09156bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a6a expref: 23 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.869242:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ee00/0xc6b8ac1b09156c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a6a expref: 22 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.869251:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910200) 00010000:00010000:3.0:1788843227.869254:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843227.869258:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799ee00, rc 0) 00000100:00100000:3.0:1788843227.869578:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+22:11380:x1875737775769600:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 629us (805us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788843227.869585:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 146 00000100:00100000:0.0:1788843227.873492:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843227.873528:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843227.873646:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775769856 00000100:00100000:1.0:1788843227.873655:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775769856 00000100:00100000:1.0:1788843227.873715:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 147 00000100:00100000:1.0:1788843227.873725:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+22:11380:x1875737775769856:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1788843227.873748:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843227.873766:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b09156d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a71 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.873863:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09156d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.873877:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09156d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.873888:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09156d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843227.873924:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788843227.874036:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b09156d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a71 expref: 25 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.874055:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09156d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a71 expref: 24 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.874064:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910200) 00010000:00010000:1.0:1788843227.874067:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788843227.874070:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b400, rc 0) 00000100:00100000:1.0:1788843227.874132:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+24:11380:x1875737775769856:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 408us (657us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1788843227.874139:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 147 00000100:00100000:2.0:1788843227.874281:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775769984 00000100:00100000:2.0:1788843227.874286:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775769984 00000100:00100000:2.0:1788843227.874331:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:2.0:1788843227.874359:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+24:2357:x1875737775769984:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843227.874370:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843227.874385:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ee00/0xc6b8ac1b09156c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a6a expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.874396:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910200) 00010000:00010000:2.0:1788843227.874400:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843227.874418:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+23:2357:x1875737775769984:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 81us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843227.874431:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:0.0:1788843227.879470:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843227.879620:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775770112 00000100:00100000:3.0:1788843227.879629:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775770112 00000100:00100000:3.0:1788843227.879693:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:3.0:1788843227.879702:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2359:x1875737775770112:12345-192.168.203.29@tcp:1:lfs.0 00010000:00010000:3.0:1788843227.879745:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084af188e/0xc6b8ac1b09156e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.879765:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f7b738d0/0xc6b8ac1b091569a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a55 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.879775:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788843227.879780:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843227.879786:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084af188e/0xc6b8ac1b09156e7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.879819:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f7b738d0/0xc6b8ac1b091569a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a55 expref: 6 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.879834:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f7b738d0/0xc6b8ac1b091569a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a55 expref: 6 pid: 8216 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843227.879861:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e779500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1875737795698432:192.168.203.29@tcp:104: 00000100:00100000:3.0:1788843227.879956:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab61fd1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843227.882560:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843227.882628:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775770240 00000100:00100000:1.0:1788843227.882637:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775770240 00002000:00100000:1.0:1788843227.882682:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8dab73a7b480 x1875737775770240/t0(0) o4->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:598/0 lens 504/0 e 0 to 0 dl 1788843238 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788843227.882694:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab73a7b480 with x1875737775770240 ext(0->12) 00010000:00010000:1.0:1788843227.882703:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f7b738d0/0xc6b8ac1b091569a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a55 expref: 7 pid: 8216 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.882718:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f7b738d0/0xc6b8ac1b091569a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a55 expref: 7 pid: 8216 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788843227.882726:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8dab73a7b480 00000100:00100000:1.0:1788843227.882757:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:1.0:1788843227.882778:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2358:x1875737775770240:12345-192.168.203.29@tcp:4:lfs.0 00000100:00100000:1.0:1788843227.883262:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+9:2358:x1875737775770240:12345-192.168.203.29@tcp:4:lfs.0 Request processed in 484us (707us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788843227.883270:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00002000:00100000:1.0:1788843227.883277:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8dab73a7b480 x1875737775770240/t4294967305(0) o4->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:598/0 lens 504/448 e 0 to 0 dl 1788843238 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788843227.883285:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab73a7b480 with x1875737775770240 ext(0->12) 00010000:00010000:1.0:1788843227.883292:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f7b738d0/0xc6b8ac1b091569a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a55 expref: 9 pid: 8216 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.883303:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f7b738d0/0xc6b8ac1b091569a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a55 expref: 9 pid: 8216 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788843227.883310:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8dab73a7b480 00000100:00100000:3.0:1788843227.883502:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e779500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6693:1875737795698432:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843227.883523:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000084af188e/0xc6b8ac1b09156e7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843227.885396:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843227.885575:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775770368 00000100:00100000:1.0:1788843227.885582:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775770368 00010000:00010000:1.0:1788843227.885612:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f7b738d0/0xc6b8ac1b091569a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a55 expref: 9 pid: 8216 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843227.885812:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:1.0:1788843227.885822:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+9:2358:x1875737775770368:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843227.885835:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788843227.885860:0:6708:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788843227.885863:0:6708:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788843227 00002000:00010000:1.0:1788843227.885866:0:6708:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788843227 00002000:00010000:1.0:1788843227.885877:0:6708:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788843227 00010000:00010000:1.0:1788843227.885884:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f7b738d0/0xc6b8ac1b091569a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a55 expref: 9 pid: 8216 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.885897:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f7b738d0/0xc6b8ac1b091569a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a55 expref: 9 pid: 8216 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.885936:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f7b738d0/0xc6b8ac1b091569a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a55 expref: 9 pid: 8216 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.885951:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843227.885955:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843227.885961:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000084af188e/0xc6b8ac1b09156e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.885971:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084af188e/0xc6b8ac1b09156e7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.886000:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843227.886047:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2358:x1875737775770368:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 226us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843227.886054:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 64 00010000:00010000:3.0:1788843227.886377:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000084af188e/0xc6b8ac1b09156e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.886395:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084af188e/0xc6b8ac1b09156e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.886420:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000084af188e/0xc6b8ac1b09156e7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.886428:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000084af188e/0xc6b8ac1b09156e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.886437:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000084af188e/0xc6b8ac1b09156e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.886445:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799e000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843227.886449:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000084af188e/0xc6b8ac1b09156e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.886458:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000084af188e/0xc6b8ac1b09156e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.886469:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000084af188e/0xc6b8ac1b09156e7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843227.886477:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084af188e/0xc6b8ac1b09156e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843227.886536:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2359:x1875737775770112:12345-192.168.203.29@tcp:1:lfs.0 Request processed in 6834us (7076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843227.886543:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:0.0:1788843227.888981:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843227.889078:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775770624 00000100:00100000:2.0:1788843227.889086:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775770624 00000100:00100000:2.0:1788843227.889642:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 38 00000100:00100000:2.0:1788843227.889655:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6640dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+23:11380:x1875737775770624:12345-192.168.203.29@tcp:35:lfs.0 00000004:00010000:2.0:1788843227.889718:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09156d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a71 expref: 23 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788843227.889942:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788843227.889980:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1788843227.890438:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:2.0:1788843227.890490:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09156ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.890504:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915685 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a47 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.890513:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09156ee lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.890544:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a47 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.890559:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915685 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a47 expref: 27 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843227.890572:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7769ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1875737795698560:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843227.890655:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab436f1540 going to sleep for 11 seconds 00000100:00100000:0.0:1788843227.893084:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7769ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1875737795698560:192.168.203.29@tcp:104: 00010000:00010000:0.0:1788843227.893110:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09156ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843227.894638:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843227.894855:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775770752 00000100:00100000:2.0:1788843227.894863:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775770752 00010000:00010000:2.0:1788843227.894898:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915685 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a47 expref: 28 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843227.894950:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00100000:2.0:1788843227.894959:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4886cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+28:2359:x1875737775770752:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843227.894973:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843227.894979:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915685 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a47 expref: 28 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.894991:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915685 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a47 expref: 28 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.895011:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915685 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a47 expref: 28 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.895035:0:7638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910200) 00010000:00010000:2.0:1788843227.895040:0:7638:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09156ee lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.895049:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09156ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.895056:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09156ee lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.895087:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843227.895138:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4886cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+27:2359:x1875737775770752:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 179us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843227.895159:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 65 00010000:00010000:1.0:1788843227.895703:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09156ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843227.895713:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09156ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788843227.895817:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:1.0:1788843227.896004:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1788843227.896153:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ce70e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1875737795698688:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788843227.896197:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843227.896228:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4936a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788843227.896332:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795698688 00000100:00100000:3.0:1788843227.896336:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795698688 00000100:00100000:3.0:1788843227.896395:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788843227.896403:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1875737795698688:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788843227.896474:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5849:x1875737795698688:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 71us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843227.896481:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788843227.896550:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ce70e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1875737795698688:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788843227.896985:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1788843227.897030:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a78700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1875737795698816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788843227.897059:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843227.897082:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41aeb900 going to sleep for 11 seconds 00000100:00100000:1.0:1788843227.897146:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795698816 00000100:00100000:1.0:1788843227.897150:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795698816 00000100:00100000:1.0:1788843227.897169:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843227.897175:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1875737795698816:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788843227.897307:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1875737795698816:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 131us (246us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788843227.897314:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788843227.897386:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a78700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1875737795698816:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788843227.897420:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788843227.897450:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09156ee lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843227.897459:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09156ee lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843227.897466:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09156ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843227.897472:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843227.897476:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09156ee lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843227.897484:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09156ee lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843227.897498:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910200) 00010000:00010000:0.0:1788843227.897507:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788843227.897512:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09156ee lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843227.897518:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09156ee lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788843227.897672:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788843227.897757:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1788843227.897768:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 352148425432ns, next at 353148423395ns, rc = 0 00000001:00080000:0.0:1788843227.897773:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:0.0:1788843227.897806:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910200) 00010000:00010000:0.0:1788843227.897810:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788843227.897817:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09156d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a71 expref: 31 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843227.897921:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6640dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+30:11380:x1875737775770624:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 8269us (8947us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1788843227.897929:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 38 00000020:00080000:0.0:1788843227.897933:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788843227.904799:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843227.904880:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775770880 00000100:00100000:2.0:1788843227.904891:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775770880 00000100:00100000:2.0:1788843227.904963:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 148 00000100:00100000:2.0:1788843227.904973:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+30:11380:x1875737775770880:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843227.905000:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843227.905024:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b09156f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a78 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.905089:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b09156f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a78 expref: 31 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.905104:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b09156f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a78 expref: 31 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843227.905123:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:2.0:1788843227.905126:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788843227.905131:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374e00, rc 0) 00000100:00100000:2.0:1788843227.905192:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+31:11380:x1875737775770880:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 221us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843227.905199:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 148 00000100:00100000:2.0:1788843227.908578:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00010000:00010000:0.0:1788843227.908578:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843227.908672:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775771136 00000100:00100000:3.0:1788843227.908686:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775771136 00000100:00100000:3.0:1788843227.908775:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:3.0:1788843227.908785:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+31:11380:x1875737775771136:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:3.0:1788843227.909016:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+32:11380:x1875737775771136:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 232us (448us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1788843227.909024:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:0.0:1788843228.027574:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843228.027775:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775771392 00000100:00100000:1.0:1788843228.027784:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775771392 00000100:00100000:1.0:1788843228.027884:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 149 00000100:00100000:1.0:1788843228.027895:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+32:11390:x1875737775771392:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1788843228.027929:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843228.027952:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b09156fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a7f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843228.028044:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788843228.028153:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b09156fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a7f expref: 34 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843228.028167:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab61f39400) 00010000:00010000:1.0:1788843228.028170:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788843228.028176:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b09156fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a7f expref: 34 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843228.028208:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b000, rc 0) 00000100:00100000:1.0:1788843228.028263:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+33:11390:x1875737775771392:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 370us (698us total) trans 4294967434 rc 301/301 00000100:00100000:1.0:1788843228.028271:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 149 00000100:00100000:0.0:1788843228.038928:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843228.039020:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775771520 00000100:00100000:2.0:1788843228.039029:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775771520 00000100:00100000:2.0:1788843228.039119:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 150 00000100:00100000:2.0:1788843228.039128:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+33:11390:x1875737775771520:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:2.0:1788843228.039217:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b091570a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039234:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b091570a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039247:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b091570a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039262:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915711 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039270:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039275:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039393:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915718 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039402:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039409:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843228.039444:0:7168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039456:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b091570a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039484:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b091570a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039492:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b091570a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039498:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843228.039502:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b091570a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039509:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b091570a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039521:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843228.039524:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843228.039529:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b091570a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039534:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b091570a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039555:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915711 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039561:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915711 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039567:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915711 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039572:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374c00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843228.039579:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915711 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039586:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915711 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039593:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab54910600) 00010000:00010000:2.0:1788843228.039596:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843228.039598:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915711 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039604:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915711 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039618:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915718 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039624:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915718 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039630:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039634:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843228.039637:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915718 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039643:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915718 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039649:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:2.0:1788843228.039651:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843228.039658:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915718 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.039664:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915718 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843228.039736:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+33:11390:x1875737775771520:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 607us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843228.039744:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 150 00000100:00100000:0.0:1788843228.042829:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843228.042981:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775771776 00000100:00100000:1.0:1788843228.042990:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775771776 00000100:00100000:0.0:1788843228.043105:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:0.0:1788843228.043114:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+33:11390:x1875737775771776:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:0.0:1788843228.044651:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+34:11390:x1875737775771776:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 1529us (1821us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788843228.044689:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:0.0:1788843228.089726:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843228.090587:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775772032 00000100:00100000:3.0:1788843228.090600:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775772032 00000100:00100000:3.0:1788843228.090677:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 151 00000100:00100000:3.0:1788843228.090688:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+34:11393:x1875737775772032:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843228.090811:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843228.091030:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b091571f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a86 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.091121:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915726 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.091136:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915726 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.091148:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915726 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.091163:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091572d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.091170:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091572d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.091176:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091572d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092170:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915734 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092185:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092202:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915734 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843228.092214:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788843228.092315:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915726 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092323:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915726 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092339:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915726 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092373:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799ea00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843228.092377:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915726 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092385:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915726 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092398:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:3.0:1788843228.092401:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843228.092406:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915726 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092413:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915726 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092428:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091572d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092434:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091572d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092440:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091572d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092445:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799e400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843228.092448:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091572d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092463:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091572d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092482:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab43e63200) 00010000:00010000:3.0:1788843228.092484:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843228.092488:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091572d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092494:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091572d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092539:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b091571f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a86 expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092553:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a86 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.092561:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:3.0:1788843228.092563:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843228.092565:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799e200, rc 0) 00000100:00100000:3.0:1788843228.092636:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+36:11393:x1875737775772032:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1949us (2919us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1788843228.092644:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 151 00000100:00100000:2.0:1788843228.096006:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843228.096092:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775772160 00000100:00100000:3.0:1788843228.096101:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775772160 00000100:00100000:3.0:1788843228.096226:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 152 00000100:00100000:3.0:1788843228.096237:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+36:11393:x1875737775772160:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:3.0:1788843228.096316:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915742 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.096364:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.096377:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.096499:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.096508:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915742 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.096516:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.096523:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799fe00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843228.096527:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.096534:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915742 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.096548:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:3.0:1788843228.096551:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843228.096555:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915742 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.096561:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915742 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843228.096693:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+36:11393:x1875737775772160:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 457us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843228.096701:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 152 00000100:00100000:0.0:1788843228.100573:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843228.100749:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775772416 00000100:00100000:3.0:1788843228.100758:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775772416 00000100:00100000:2.0:1788843228.101041:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:2.0:1788843228.101053:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+36:11393:x1875737775772416:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1788843228.101278:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+37:11393:x1875737775772416:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 227us (713us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788843228.101286:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:0.0:1788843228.422761:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843228.422969:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775772672 00000100:00100000:1.0:1788843228.422979:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775772672 00000100:00100000:1.0:1788843228.423045:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 153 00000100:00100000:1.0:1788843228.423056:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+37:11424:x1875737775772672:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:1.0:1788843228.423082:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843228.423102:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915749 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a8d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843228.423196:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915750 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843228.423211:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843228.423222:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843228.423233:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788843228.423496:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915749 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a8d expref: 40 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843228.423516:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915750 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a8d expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843228.423537:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:1.0:1788843228.423540:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843228.423543:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b400, rc 0) 00000100:00100000:1.0:1788843228.423609:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+39:11424:x1875737775772672:12345-192.168.203.29@tcp:101:cat.0 Request processed in 555us (856us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788843228.423617:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 153 00000100:00100000:2.0:1788843228.427173:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843228.427246:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775772800 00000100:00100000:1.0:1788843228.427255:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775772800 00000100:00100000:1.0:1788843228.427317:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:1.0:1788843228.427337:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+39:2356:x1875737775772800:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843228.427373:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843228.427398:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915750 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a8d expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843228.427420:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:1.0:1788843228.427425:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843228.427484:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+38:2356:x1875737775772800:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 149us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843228.427492:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:3.0:1788843228.427799:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843228.427949:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775773056 00000100:00100000:0.0:1788843228.427954:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775773056 00000100:00100000:0.0:1788843228.427994:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:0.0:1788843228.428002:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+38:11424:x1875737775773056:12345-192.168.203.29@tcp:35:cat.0 00000100:00100000:0.0:1788843228.437512:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+39:11424:x1875737775773056:12345-192.168.203.29@tcp:35:cat.0 Request processed in 9498us (9701us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788843228.437528:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:2.0:1788843228.517338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843228.518563:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775773312 00000100:00100000:0.0:1788843228.518578:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775773312 00000100:00100000:0.0:1788843228.518666:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 154 00000100:00100000:0.0:1788843228.518677:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+39:11430:x1875737775773312:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:0.0:1788843228.518708:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843228.518712:0:7168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788843228.518759:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b09156b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a63 expref: 39 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843228.518786:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:0.0:1788843228.518792:0:7168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843228.518809:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b091575e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a94 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843228.519283:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915765 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843228.519630:0:7168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915734 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a86 expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843228.519643:0:7168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915765 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843228.519688:0:7168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915734 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a86 expref: 39 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843228.519705:0:7168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915734 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a86 expref: 39 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843228.519721:0:7168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7168:1875737795698944:192.168.203.29@tcp:104: 00000100:00100000:0.0:1788843228.520017:0:7168:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4936a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843228.528244:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843228.529028:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775773440 00000100:00100000:3.0:1788843228.529042:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775773440 00010000:00010000:3.0:1788843228.529097:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915734 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a86 expref: 40 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843228.529150:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:3.0:1788843228.529161:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+40:2358:x1875737775773440:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843228.529180:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843228.529188:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915734 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a86 expref: 40 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.529204:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915734 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a86 expref: 40 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.529232:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:3.0:1788843228.529238:0:6708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915765 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.529248:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915765 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.529256:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915765 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.529291:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843228.529680:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+40:2358:x1875737775773440:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 519us (1449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843228.529690:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 66 00010000:00010000:2.0:1788843228.529915:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915734 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a86 expref: 39 pid: 5847 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843228.529937:0:7168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7168:1875737795698944:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843228.529965:0:7168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915765 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.529975:0:7168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915765 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.529981:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915765 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843228.530012:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788843228.530203:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b091575e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a94 expref: 40 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.530221:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915765 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a94 expref: 39 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.530231:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:2.0:1788843228.530233:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788843228.530236:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4a00, rc 0) 00000100:00100000:2.0:1788843228.530270:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+39:11430:x1875737775773312:12345-192.168.203.29@tcp:101:dd.0 Request processed in 11595us (12954us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788843228.530278:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 154 00000100:00100000:2.0:1788843228.533987:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843228.534214:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775773696 00000100:00100000:3.0:1788843228.534228:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775773696 00000100:00100000:3.0:1788843228.534322:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 155 00000100:00100000:3.0:1788843228.534335:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+39:11430:x1875737775773696:12345-192.168.203.29@tcp:36:dd.0 00010000:00010000:3.0:1788843228.534947:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915773 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.534974:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843228.534988:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788843228.535051:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:3.0:1788843228.535076:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000970b1d53 reply state 0000000047704ab0 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843228.535086:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788843228.535217:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+42:11430:x1875737775773696:12345-192.168.203.29@tcp:36:dd.0 Request processed in 883us (1244us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788843228.535226:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 155 00000020:00080000:3.0:1788843228.535232:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788843228.544168:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.544192:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915773 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.544201:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915773 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.544208:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799fe00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843228.544213:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915773 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.544222:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915773 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.544262:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:2.0:1788843228.544266:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843228.544272:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915773 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843228.544279:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0915773 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843228.932572:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843229.141513:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843229.142777:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775773824 00000100:00100000:3.0:1788843229.142789:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775773824 00000100:00100000:3.0:1788843229.142886:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 156 00000100:00100000:3.0:1788843229.142923:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6ec49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+41:11444:x1875737775773824:12345-192.168.203.29@tcp:101:stat.0 00010000:00010000:3.0:1788843229.142946:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843229.142965:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b091577a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084a9b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.143028:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915781 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.143043:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915781 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.143053:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915781 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.143066:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915788 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.143073:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.143079:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.143159:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b091578f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.143170:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915765 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a94 expref: 42 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.143178:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b091578f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.143223:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915765 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a94 expref: 42 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.143237:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915765 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a94 expref: 42 pid: 7168 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843229.143251:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e778e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795699072:192.168.203.29@tcp:104: 00000100:00100000:3.0:1788843229.143860:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab61fd1cc0 going to sleep for 11 seconds 00000100:00080000:2.0:1788843229.143930:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843229.155862:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843229.156043:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775774080 00000100:00100000:1.0:1788843229.156053:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775774080 00000100:00100000:1.0:1788843229.156113:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:1.0:1788843229.156123:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+43:5596:x1875737775774080:12345-192.168.203.29@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788843229.156491:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+44:5596:x1875737775774080:12345-192.168.203.29@tcp:35:ldlm_bl.0 Request processed in 368us (638us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1788843229.156514:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:3.0:1788843229.158025:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e778e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795699072:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843229.158053:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b091578f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843229.161539:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843229.161914:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775774208 00000100:00100000:0.0:1788843229.161924:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775774208 00010000:00010000:0.0:1788843229.161966:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915765 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a94 expref: 44 pid: 7168 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843229.162042:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 67 00000100:00100000:0.0:1788843229.162051:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+44:2359:x1875737775774208:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843229.162067:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843229.162075:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915765 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a94 expref: 44 pid: 7168 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.162105:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915765 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a94 expref: 44 pid: 7168 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.162130:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915765 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084a94 expref: 44 pid: 7168 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.162146:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:0.0:1788843229.162152:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b091578f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.162161:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b091578f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.162168:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b091578f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.162199:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843229.162259:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+43:2359:x1875737775774208:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 208us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843229.162266:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 67 00010000:00010000:3.0:1788843229.169416:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b091578f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169434:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b091578f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843229.169482:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788843229.169486:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788843229.169513:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b091578f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169528:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b091578f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169538:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915781 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169562:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915781 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169570:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915781 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169576:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799e400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843229.169581:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915781 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169589:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915781 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169605:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:3.0:1788843229.169608:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843229.169624:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915781 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169631:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915781 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169648:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169655:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915788 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169661:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915788 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169667:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799ea00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843229.169676:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915788 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169683:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915788 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169692:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab43e63200) 00010000:00010000:3.0:1788843229.169694:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843229.169697:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915788 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169704:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915788 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169746:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b091577a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a9b expref: 43 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169761:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b091578f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a9b expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.169769:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:3.0:1788843229.169771:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843229.169774:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799ec00, rc 0) 00000100:00100000:3.0:1788843229.169862:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6ec49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+42:11444:x1875737775773824:12345-192.168.203.29@tcp:101:stat.0 Request processed in 26942us (28357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843229.169870:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 156 00000100:00100000:1.0:1788843229.263004:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843229.263087:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775774464 00000100:00100000:3.0:1788843229.263097:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775774464 00000100:00100000:3.0:1788843229.263159:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 157 00000100:00100000:3.0:1788843229.263169:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+42:11449:x1875737775774464:12345-192.168.203.29@tcp:36:truncate.0 00010000:00010000:3.0:1788843229.263238:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843229.263264:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b091578f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a9b expref: 42 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.263282:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:3.0:1788843229.263287:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843229.263741:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915796 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.263756:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.263767:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788843229.263832:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:3.0:1788843229.263860:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000241e42af reply state 00000000666671b1 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843229.263868:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788843229.263975:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+44:11449:x1875737775774464:12345-192.168.203.29@tcp:36:truncate.0 Request processed in 805us (978us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1788843229.263982:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 157 00000020:00080000:3.0:1788843229.263988:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788843229.276583:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915796 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.276600:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915796 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.276608:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915796 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.276632:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799e000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843229.276636:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915796 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.276644:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915796 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.276662:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:3.0:1788843229.276665:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843229.276670:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915796 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.276677:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915796 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843229.495714:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843229.496447:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775774592 00000100:00100000:0.0:1788843229.496475:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775774592 00000100:00100000:0.0:1788843229.496563:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 158 00000100:00100000:0.0:1788843229.496576:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+43:11464:x1875737775774592:12345-192.168.203.29@tcp:101:stat.0 00010000:00010000:0.0:1788843229.496610:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843229.496638:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b091579d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084aa2 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.496755:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09157a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.496772:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09157a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.496785:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09157a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.496800:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09157ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.496807:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09157ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.496813:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09157ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.496933:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09157b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.496942:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09157b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.496949:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09157b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843229.496992:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788843229.496997:0:7168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788843229.497025:0:7168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09157b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.497049:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09157b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.497057:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09157a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.497063:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09157a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.497070:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09157a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.497075:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843229.497080:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09157a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.497088:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09157a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.497101:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:0.0:1788843229.497105:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843229.497110:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09157a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.497117:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09157a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.497131:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09157ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.497138:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09157ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.497154:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09157ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.497160:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843229.497162:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09157ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.497169:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09157ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.497176:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab43eceb00) 00010000:00010000:0.0:1788843229.497179:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843229.497181:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09157ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.497187:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09157ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.497223:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b091579d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084aa2 expref: 45 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.497237:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09157b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084aa2 expref: 44 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.497244:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:0.0:1788843229.497246:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843229.497249:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4e00, rc 0) 00000100:00100000:0.0:1788843229.497739:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+44:11464:x1875737775774592:12345-192.168.203.29@tcp:101:stat.0 Request processed in 1165us (2038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843229.497758:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 158 00000100:00100000:2.0:1788843229.607558:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843229.607707:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775774848 00000100:00100000:3.0:1788843229.607720:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775774848 00000100:00100000:3.0:1788843229.607805:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 159 00000100:00100000:3.0:1788843229.607817:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+44:11474:x1875737775774848:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843229.607846:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843229.607874:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09157b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084aa9 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843229.608003:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788843229.608158:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09157b9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084aa9 expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.608176:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab61f39400) 00010000:00010000:3.0:1788843229.608200:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843229.608208:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09157b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084aa9 expref: 46 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.608226:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799e000, rc 0) 00000100:00100000:3.0:1788843229.608320:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+45:11474:x1875737775774848:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 505us (776us total) trans 4294967446 rc 301/301 00000100:00100000:3.0:1788843229.608328:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 159 00000100:00100000:2.0:1788843229.619802:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843229.623799:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775775104 00000100:00100000:1.0:1788843229.623820:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775775104 00000100:00100000:1.0:1788843229.623921:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:1.0:1788843229.623939:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6640ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+45:11474:x1875737775775104:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:1.0:1788843229.624291:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6640ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+46:11474:x1875737775775104:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 354us (4502us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788843229.624299:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:0.0:1788843229.726095:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843229.726249:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775775360 00000100:00100000:2.0:1788843229.726264:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775775360 00000100:00100000:2.0:1788843229.726424:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 160 00000100:00100000:2.0:1788843229.726439:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+46:11480:x1875737775775360:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1788843229.726474:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843229.726505:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b09157c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ab0 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.726644:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.726662:0:7168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09157b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084aa2 expref: 47 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.726672:0:7168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ce lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.726736:0:7168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09157b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084aa2 expref: 47 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.726751:0:7168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09157b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084aa2 expref: 47 pid: 7168 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843229.726767:0:7168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e848000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7168:1875737795699200:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843229.726889:0:7168:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab436f1240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843229.732549:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843229.732967:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775775488 00000100:00100000:1.0:1788843229.732983:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775775488 00010000:00010000:1.0:1788843229.733050:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09157b2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084aa2 expref: 48 pid: 7168 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843229.733112:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 68 00000100:00100000:1.0:1788843229.733124:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c140000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+48:2358:x1875737775775488:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843229.733143:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843229.733152:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09157b2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084aa2 expref: 48 pid: 7168 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843229.733168:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09157b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084aa2 expref: 48 pid: 7168 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843229.733199:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:1.0:1788843229.733218:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843229.733231:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843229.733242:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ce lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843229.733268:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843229.733396:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c140000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+48:2358:x1875737775775488:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 274us (857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843229.733405:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 68 00010000:00010000:0.0:1788843229.736491:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09157b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084aa2 expref: 47 pid: 7168 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843229.736523:0:7168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e848000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7168:1875737795699200:192.168.203.29@tcp:104: 00010000:00010000:0.0:1788843229.736561:0:7168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.736573:0:7168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.736579:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843229.736608:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788843229.736825:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b09157c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ab0 expref: 48 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.736869:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ab0 expref: 47 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843229.736879:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:0.0:1788843229.736883:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788843229.736886:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374600, rc 0) 00000100:00100000:0.0:1788843229.736996:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+47:11480:x1875737775775360:12345-192.168.203.29@tcp:101:bash.0 Request processed in 10560us (10921us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1788843229.737005:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 160 00000100:00100000:2.0:1788843229.739441:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843229.739890:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775775744 00000100:00100000:3.0:1788843229.739909:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775775744 00000100:00100000:3.0:1788843229.739971:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 161 00000100:00100000:3.0:1788843229.739982:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+47:11480:x1875737775775744:12345-192.168.203.29@tcp:36:bash.0 00010000:00010000:3.0:1788843229.740248:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09157dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.740267:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09157dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.740278:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09157dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788843229.740336:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:3.0:1788843229.740400:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000026601fb reply state 00000000429d4ba7 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09157dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843229.740410:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788843229.740519:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+50:11480:x1875737775775744:12345-192.168.203.29@tcp:36:bash.0 Request processed in 538us (1091us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788843229.740526:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 161 00000020:00080000:3.0:1788843229.740532:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788843229.743186:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09157dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.743211:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09157dc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.743220:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09157dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.743226:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799e000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843229.743232:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09157dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.743242:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09157dc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.743264:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:2.0:1788843229.743268:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843229.743273:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09157dc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.743543:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09157dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843229.747977:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843229.748156:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775775872 00000100:00100000:3.0:1788843229.748173:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775775872 00000100:00100000:3.0:1788843229.748255:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 162 00000100:00100000:3.0:1788843229.748269:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+49:11480:x1875737775775872:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1788843229.748304:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843229.756572:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b09157e3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ab7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.756745:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b09157ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.756769:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ab0 expref: 50 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.756780:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b09157ea lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.756828:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ab0 expref: 50 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.756844:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ab0 expref: 50 pid: 7168 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843229.756863:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e778e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795699328:192.168.203.29@tcp:104: 00000100:00100000:3.0:1788843229.756989:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab61fd1900 going to sleep for 11 seconds 00000100:00100000:3.0:1788843229.759054:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e778e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795699328:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843229.759092:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b09157ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843229.759749:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843229.766582:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775776000 00000100:00100000:3.0:1788843229.766605:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775776000 00010000:00010000:2.0:1788843229.766771:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ab0 expref: 51 pid: 7168 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843229.766834:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:2.0:1788843229.766846:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c141f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+51:2358:x1875737775776000:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843229.766864:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843229.766872:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ab0 expref: 51 pid: 7168 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.766886:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ab0 expref: 51 pid: 7168 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.766926:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ab0 expref: 51 pid: 7168 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.766964:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:2.0:1788843229.766970:0:6708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b09157ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.766980:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b09157ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.767013:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b09157ea lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.767053:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843229.767260:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b09157ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.767270:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b09157ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843229.767572:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788843229.767578:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788843229.767606:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b09157ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.767649:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b09157e3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ab7 expref: 51 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.767666:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b09157ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ab7 expref: 50 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.767674:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:3.0:1788843229.767677:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843229.767680:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799ea00, rc 0) 00000100:00100000:2.0:1788843229.768258:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c141f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+50:2358:x1875737775776000:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 1410us (8508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843229.768269:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:3.0:1788843229.769064:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+49:11480:x1875737775775872:12345-192.168.203.29@tcp:101:bash.0 Request processed in 20793us (21090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843229.769076:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 162 00000100:00100000:0.0:1788843229.780057:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843229.780213:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775776256 00000100:00100000:1.0:1788843229.780226:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775776256 00000100:00100000:1.0:1788843229.780298:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:1.0:1788843229.780319:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+49:11480:x1875737775776256:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:1.0:1788843229.780685:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+50:11480:x1875737775776256:12345-192.168.203.29@tcp:35:bash.0 Request processed in 376us (643us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1788843229.780694:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:1.0:1788843229.883723:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843229.883866:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775776512 00000100:00100000:3.0:1788843229.883880:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775776512 00000100:00100000:3.0:1788843229.883977:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 163 00000100:00100000:3.0:1788843229.883992:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+50:11491:x1875737775776512:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843229.884052:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843229.884089:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b09157f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084abe expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843229.884236:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788843229.884491:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b09157f1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084abe expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.884510:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab61f39400) 00010000:00010000:3.0:1788843229.884513:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843229.884519:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b09157f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084abe expref: 52 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.884537:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799ec00, rc 0) 00000100:00100000:3.0:1788843229.884603:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+51:11491:x1875737775776512:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 614us (897us total) trans 4294967452 rc 301/301 00000100:00100000:3.0:1788843229.884611:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 163 00000100:00100000:0.0:1788843229.894249:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843229.894461:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775776640 00000100:00100000:2.0:1788843229.894475:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775776640 00000100:00100000:2.0:1788843229.894554:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 164 00000100:00100000:2.0:1788843229.894569:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+51:11491:x1875737775776640:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:2.0:1788843229.894697:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.894722:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.894738:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.894759:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0915806 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.894766:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0915806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.894773:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0915806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.894931:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b091580d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.894962:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b091580d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.894971:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b091580d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843229.895041:0:7168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b091580d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895060:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895068:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895078:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895085:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374600 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843229.895091:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895101:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895118:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843229.895121:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843229.895128:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895135:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b09157ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895181:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0915806 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895188:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0915806 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895195:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0915806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895200:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375c00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843229.895203:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0915806 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895210:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0915806 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895218:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab54910600) 00010000:00010000:2.0:1788843229.895220:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843229.895223:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0915806 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895228:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0915806 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895246:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b091580d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895253:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b091580d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895260:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b091580d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895271:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843229.895275:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b091580d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895281:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b091580d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895290:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:2.0:1788843229.895293:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843229.895296:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b091580d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.895302:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b091580d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843229.895436:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+51:11491:x1875737775776640:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 869us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843229.895445:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 164 00000100:00100000:0.0:1788843229.905214:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843229.905320:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775776896 00000100:00100000:1.0:1788843229.905334:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775776896 00000100:00100000:1.0:1788843229.905433:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:1.0:1788843229.905444:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+51:11491:x1875737775776896:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:1.0:1788843229.905742:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+52:11491:x1875737775776896:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 297us (541us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788843229.905750:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:1.0:1788843229.944194:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843229.945508:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775777152 00000100:00100000:3.0:1788843229.945522:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775777152 00000100:00100000:3.0:1788843229.945605:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 165 00000100:00100000:3.0:1788843229.945616:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+52:11494:x1875737775777152:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843229.945639:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843229.945660:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915814 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ac5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.945756:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091581b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.945781:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091581b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.945792:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091581b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.945808:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b0915822 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.945815:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b0915822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.945822:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b0915822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.945944:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b0915829 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.945953:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b0915829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.945960:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b0915829 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843229.945969:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788843229.946061:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091581b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.946068:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091581b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.946075:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091581b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.946088:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799e400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843229.946093:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091581b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.946101:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091581b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.946113:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:3.0:1788843229.946117:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843229.946122:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091581b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.946128:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091581b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.946142:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b0915822 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.946149:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b0915822 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.946155:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b0915822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.946160:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799f200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843229.946163:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b0915822 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.946170:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b0915822 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.946188:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab43e63200) 00010000:00010000:3.0:1788843229.946191:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843229.946194:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b0915822 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.946200:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b0915822 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.946239:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915814 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ac5 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.946252:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b0915829 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ac5 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.946259:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:3.0:1788843229.946261:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843229.946264:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799f600, rc 0) 00000100:00100000:3.0:1788843229.946339:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+54:11494:x1875737775777152:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 725us (2175us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788843229.946403:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 165 00000100:00100000:0.0:1788843229.955870:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843229.955919:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843229.956119:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775777408 00000100:00100000:2.0:1788843229.956129:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775777408 00000100:00100000:2.0:1788843229.956208:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:2.0:1788843229.956219:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+54:2358:x1875737775777408:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843229.956237:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843229.956263:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b0915829 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ac5 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843229.956281:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:2.0:1788843229.956286:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843229.956401:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+53:2358:x1875737775777408:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 183us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843229.956408:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00010000:00010000:2.0:1788843229.956763:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843229.960023:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775777280 00000100:00100000:3.0:1788843229.960041:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775777280 00000100:00100000:3.0:1788843229.960140:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 166 00000100:00100000:3.0:1788843229.960151:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+53:11494:x1875737775777280:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:3.0:1788843229.960235:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915837 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.960255:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.960288:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.960330:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915837 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.960338:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915837 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.960384:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915837 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.960390:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799ec00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843229.960395:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915837 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.960403:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915837 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.960417:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:3.0:1788843229.960421:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843229.960427:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915837 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843229.960433:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915837 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843229.961570:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+53:11494:x1875737775777280:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 835us (5123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843229.961584:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 166 00000100:00100000:0.0:1788843229.965495:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843229.965706:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775777664 00000100:00100000:3.0:1788843229.965732:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775777664 00000100:00100000:3.0:1788843229.965798:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:3.0:1788843229.965810:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+53:11494:x1875737775777664:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:3.0:1788843229.966296:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+54:11494:x1875737775777664:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 487us (810us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788843229.966313:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:1.0:1788843230.177182:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843230.177300:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775777920 00000100:00100000:3.0:1788843230.177325:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775777920 00000100:00100000:3.0:1788843230.177470:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 167 00000100:00100000:3.0:1788843230.177483:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+54:11512:x1875737775777920:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:3.0:1788843230.177512:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843230.177532:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b091583e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084acc expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.177637:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b0915845 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.177653:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b0915845 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.178471:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b0915845 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843230.178492:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788843230.178635:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b091583e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084acc expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.178655:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b0915845 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084acc expref: 56 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.178696:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:3.0:1788843230.178700:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788843230.178703:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799f200, rc 0) 00000100:00100000:3.0:1788843230.178776:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+56:11512:x1875737775777920:12345-192.168.203.29@tcp:101:cat.0 Request processed in 1295us (1604us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1788843230.178785:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 167 00000100:00100000:1.0:1788843230.218628:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843230.219656:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775778048 00000100:00100000:2.0:1788843230.219673:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775778048 00000100:00100000:2.0:1788843230.219755:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 168 00000100:00100000:2.0:1788843230.219766:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+56:11513:x1875737775778048:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843230.219794:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843230.219819:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0915853 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ad3 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.219900:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b091585a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.219914:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b091585a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.219926:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b091585a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843230.219963:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788843230.219967:0:7168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843230.219985:0:7168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b091585a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.220012:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0915853 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ad3 expref: 58 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.220046:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b091585a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ad3 expref: 57 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.220071:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843230.220074:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843230.220079:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375c00, rc 0) 00000100:00100000:2.0:1788843230.220150:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+57:11513:x1875737775778048:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 387us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843230.220157:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 168 00000100:00100000:0.0:1788843230.229585:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843230.230052:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775778432 00000100:00100000:2.0:1788843230.230068:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775778432 00000100:00100000:2.0:1788843230.230148:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:2.0:1788843230.230162:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+57:11513:x1875737775778432:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:2.0:1788843230.230819:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+58:11513:x1875737775778432:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 655us (1245us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788843230.230830:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:2.0:1788843230.234263:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843230.234384:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775778560 00000100:00100000:1.0:1788843230.234396:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775778560 00000100:00100000:0.0:1788843230.234564:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:0.0:1788843230.234579:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4886d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+58:11513:x1875737775778560:12345-192.168.203.29@tcp:103:lfs.0 00010000:00010000:0.0:1788843230.234600:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788843230.234631:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b09157ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ab7 expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.234657:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b0915845 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084acc expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.234670:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b09156f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a78 expref: 56 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.234699:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910300) 00010000:00010000:0.0:1788843230.234713:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843230.234787:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4886d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+55:11513:x1875737775778560:12345-192.168.203.29@tcp:103:lfs.0 Request processed in 212us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843230.234796:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:1.0:1788843230.237207:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843230.237332:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775778688 00000100:00100000:2.0:1788843230.237525:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775778688 00000100:00100000:2.0:1788843230.237714:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 169 00000100:00100000:2.0:1788843230.237728:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+55:11513:x1875737775778688:12345-192.168.203.29@tcp:58:lfs.0 00010000:00010000:2.0:1788843230.237966:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915861 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.237989:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915861 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.238004:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915861 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843230.238387:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1788843230.238514:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+55:11513:x1875737775778688:12345-192.168.203.29@tcp:58:lfs.0 Request processed in 788us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843230.238524:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 169 00000100:00100000:2.0:1788843230.263899:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843230.264044:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775778816 00000100:00100000:3.0:1788843230.264062:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775778816 00000100:00100000:3.0:1788843230.264143:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 170 00000100:00100000:3.0:1788843230.264156:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+55:11515:x1875737775778816:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843230.264181:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843230.264209:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915868 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ada expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.264302:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091586f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.264320:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091586f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.264333:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091586f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.264390:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0915876 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.264399:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0915876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.264430:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0915876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.264658:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091587d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.264667:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091587d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.264675:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091587d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843230.264724:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788843230.264730:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788843230.264753:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091587d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.264768:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091587d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.264778:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091586f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.264785:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091586f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.264794:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091586f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.264800:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799e400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843230.264805:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091586f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.264823:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091586f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.264839:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:3.0:1788843230.265096:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843230.265103:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091586f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.265110:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091586f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.265125:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0915876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.265132:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0915876 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.265139:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0915876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.265144:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799f400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843230.265148:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0915876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.265154:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0915876 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.265163:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab43e63200) 00010000:00010000:3.0:1788843230.265166:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843230.265169:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0915876 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.265186:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0915876 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.265225:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915868 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ada expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.265242:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091587d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ada expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.265251:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910600) 00010000:00010000:3.0:1788843230.265253:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843230.265256:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799f200, rc 0) 00000100:00100000:3.0:1788843230.265424:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+56:11515:x1875737775778816:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1270us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843230.265433:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 170 00000100:00100000:0.0:1788843230.351439:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843230.351493:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843230.351514:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843230.351590:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843230.351760:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775779200 00000100:00100000:2.0:1788843230.351774:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775779200 00000100:00100000:2.0:1788843230.351858:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775779072 00000100:00100000:2.0:1788843230.351861:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775779072 00000100:00100000:2.0:1788843230.351905:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 89 00000100:00100000:2.0:1788843230.351919:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2358:x1875737775779200:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843230.352020:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e8e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2358:x1875737775779200:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 104us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843230.352028:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 89 00000100:00100000:2.0:1788843230.352052:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 90 00000100:00100000:2.0:1788843230.352060:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775779072:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843230.352088:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775779072:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 29us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843230.352095:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 90 00000100:00080000:0.0:1788843230.352327:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788843230.352333:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843230.352426:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775778944 00000100:00100000:3.0:1788843230.352431:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775778944 00000100:00100000:3.0:1788843230.352481:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 290 00000100:00100000:3.0:1788843230.352490:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2358:x1875737775778944:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843230.352542:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2358:x1875737775778944:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 53us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843230.352549:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 290 00000100:00100000:3.0:1788843230.352594:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775779328 00000100:00100000:3.0:1788843230.352599:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775779328 00000100:00100000:3.0:1788843230.352641:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 150 00000100:00100000:3.0:1788843230.352649:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2358:x1875737775779328:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843230.352692:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2358:x1875737775779328:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 43us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843230.352699:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 150 00000100:00080000:0.0:1788843230.352819:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843230.532726:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795699456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843230.532813:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843230.532912:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795699456 00000100:00100000:3.0:1788843230.532925:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795699456 00000100:00080000:0.0:1788843230.533039:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843230.533430:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788843230.533443:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7769ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795699456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843230.533501:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788843230.533588:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7769ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795699456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843230.533595:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788843230.533712:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795699456:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788843230.852599:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788843230.852608:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788843230.852650:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1788843230.852656:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788843230.852822:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c143480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875737795699584:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788843230.852988:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab50452a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788843230.871033:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843230.871136:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775779456 00000100:00100000:0.0:1788843230.871150:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775779456 00000100:00100000:0.0:1788843230.871269:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 171 00000100:00100000:0.0:1788843230.871285:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+57:11526:x1875737775779456:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000100:00100000:3.0:1788843230.871313:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c143480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875737795699584:192.168.203.29@tcp:107:hsm_cdtr.0 00000004:00000080:0.0:1788843230.871329:0:7168:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788843230.871493:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+56:11526:x1875737775779456:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 211us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843230.871503:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 171 00000100:00100000:0.0:1788843230.879993:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843230.882957:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775779584 00000100:00100000:3.0:1788843230.882984:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775779584 00000100:00100000:3.0:1788843230.884607:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 172 00000100:00100000:3.0:1788843230.884631:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+56:11526:x1875737775779584:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788843230.884741:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915884 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.884764:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915884 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.884783:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915884 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.884802:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b091588b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.884827:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b091588b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.884836:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b091588b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.884980:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915892 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.884991:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.884999:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843230.885045:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788843230.885049:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788843230.885064:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885078:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915884 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885085:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915884 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885093:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915884 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885100:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799ec00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843230.885105:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915884 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885119:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915884 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885134:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab61f39d00) 00010000:00010000:3.0:1788843230.885138:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843230.885144:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915884 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885151:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ec00/0xc6b8ac1b0915884 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885163:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b091588b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885170:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b091588b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885176:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b091588b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885180:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799f400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843230.885184:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b091588b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885190:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b091588b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885198:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8dab43e63200) 00010000:00010000:3.0:1788843230.885201:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843230.885203:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b091588b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885221:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b091588b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885236:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915892 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885243:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915892 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885249:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885254:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799e400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843230.885258:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915892 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885264:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915892 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885272:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910600) 00010000:00010000:3.0:1788843230.885274:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843230.885278:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915892 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.885284:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b0915892 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843230.885417:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+56:11526:x1875737775779584:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 Request processed in 794us (5439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843230.885427:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 172 00000100:00100000:0.0:1788843230.890121:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843230.890251:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775779840 00000100:00100000:2.0:1788843230.890266:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775779840 00000100:00100000:2.0:1788843230.890424:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 173 00000100:00100000:2.0:1788843230.890438:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+56:11526:x1875737775779840:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843230.890470:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843230.890500:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0915899 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ae1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.890630:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b09158a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.890648:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b09158a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.890662:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b09158a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843230.890677:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788843230.890815:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b09158a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.890824:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b09158a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.890832:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b09158a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.890839:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843230.890844:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b09158a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.890854:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b09158a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.890900:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910600) 00010000:00010000:2.0:1788843230.890904:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843230.890910:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b09158a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.890917:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b09158a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.890984:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0915899 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ae1 expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.890996:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab61f39d00) 00010000:00010000:2.0:1788843230.890999:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843230.891003:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0915899 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ae1 expref: 58 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.891016:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375600, rc 0) 00000100:00100000:2.0:1788843230.891111:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+57:11526:x1875737775779840:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 676us (1003us total) trans 4294967458 rc 301/301 00000100:00100000:2.0:1788843230.891120:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 173 00000100:00100000:0.0:1788843230.897754:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843230.897904:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775779968 00000100:00100000:2.0:1788843230.897917:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775779968 00000100:00100000:2.0:1788843230.898047:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 174 00000100:00100000:2.0:1788843230.898060:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+57:11526:x1875737775779968:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788843230.898107:0:5848:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788843230.898246:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+57:11526:x1875737775779968:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 187us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843230.898275:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 174 00000100:00100000:0.0:1788843230.901717:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843230.901835:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775780224 00000100:00100000:2.0:1788843230.901946:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775780224 00000100:00100000:2.0:1788843230.902023:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 175 00000100:00100000:2.0:1788843230.902035:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+57:11526:x1875737775780224:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843230.902061:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843230.902066:0:7168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788843230.902101:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b091585a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ad3 expref: 57 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.902140:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843230.902146:0:7168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843230.902163:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b09158ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ae8 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788843230.906209:0:7168:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788843230.906807:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b09158b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.906830:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b09158b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.906846:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b09158b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.907014:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b09158ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ae8 expref: 59 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.907081:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b09158b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ae8 expref: 58 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.907092:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dab54910a00) 00010000:00010000:2.0:1788843230.907095:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843230.907099:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374200, rc 0) 00000100:00100000:2.0:1788843230.907253:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+58:11526:x1875737775780224:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 5219us (5547us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788843230.907264:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 175 00000100:00100000:0.0:1788843230.911651:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843230.911810:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775780480 00000100:00100000:3.0:1788843230.911823:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775780480 00000100:00100000:3.0:1788843230.911968:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 176 00000100:00100000:3.0:1788843230.911982:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+58:11526:x1875737775780480:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788843230.912077:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843230.912110:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b09158b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ae8 expref: 58 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.912149:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dab54910a00) 00010000:00010000:3.0:1788843230.912165:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843230.912193:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b09158c3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.912209:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b09158c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.912221:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b09158c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.912237:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09158ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf5ad6dd6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.912245:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09158ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5ad6dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.912252:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09158ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5ad6dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.913211:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b09158c3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.913227:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b09158c3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.913236:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b09158c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.913243:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799e400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843230.913270:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b09158c3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.913280:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b09158c3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.913295:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:0.0:1788843230.913608:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843230.913617:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b09158c3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.913625:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b09158c3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.913640:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09158ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5ad6dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.913647:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09158ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5ad6dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.913653:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09158ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5ad6dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.913659:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799f400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843230.913662:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09158ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5ad6dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.913669:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09158ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5ad6dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.913678:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf5ad6dd6 (ffff8dab43e63200) 00010000:00010000:0.0:1788843230.913681:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843230.913692:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09158ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf5ad6dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.913698:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09158ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf5ad6dd6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843230.914000:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+57:11526:x1875737775780480:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 2017us (2361us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788843230.914010:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 176 00000100:00100000:0.0:1788843230.916690:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843230.916793:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775780608 00000100:00100000:2.0:1788843230.916806:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775780608 00000100:00100000:2.0:1788843230.917162:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 177 00000100:00100000:2.0:1788843230.917177:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+57:11526:x1875737775780608:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843230.917205:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843230.917243:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09158d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084aef expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.917295:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09158d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.917322:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09158d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.917335:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09158d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.917518:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09158d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084aef expref: 59 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.917565:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09158d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084aef expref: 58 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.917576:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:2.0:1788843230.917580:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788843230.917585:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374a00, rc 0) 00000100:00100000:2.0:1788843230.917657:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+58:11526:x1875737775780608:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 485us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843230.917665:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 177 00000100:00100000:1.0:1788843230.926950:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843230.935588:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775780864 00000100:00100000:3.0:1788843230.935612:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775780864 00000100:00100000:2.0:1788843230.938185:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 178 00000100:00100000:2.0:1788843230.938205:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+58:11526:x1875737775780864:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788843230.938404:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09158df lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.938429:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09158df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.938443:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09158df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843230.938908:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:2.0:1788843230.938924:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 355189581997ns, next at 356189577637ns, rc = 0 00000004:00010000:2.0:1788843230.939051:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004421b0e9 reply state 00000000a3a77fc9 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09158df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843230.939066:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788843230.939230:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43783100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+60:11526:x1875737775780864:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 1028us (12297us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1788843230.939251:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 178 00010000:00010000:3.0:1788843230.946614:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09158df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.946645:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09158df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.946654:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09158df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.946661:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375c00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843230.946667:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09158df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.946676:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09158df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.946698:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:3.0:1788843230.946702:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788843230.946708:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09158df lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843230.946715:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09158df lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843230.948798:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843230.949292:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775780992 00000100:00100000:3.0:1788843230.949316:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775780992 00000100:00100000:0.0:1788843230.949562:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 179 00000100:00100000:0.0:1788843230.949577:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+59:11526:x1875737775780992:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843230.949728:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843230.949760:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09158e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084af6 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.949845:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09158e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084af6 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.949863:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09158e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084af6 expref: 60 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.949900:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:0.0:1788843230.949904:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788843230.949909:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4e00, rc 0) 00000100:00100000:0.0:1788843230.950482:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+60:11526:x1875737775780992:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 906us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843230.950509:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 179 00000100:00100000:1.0:1788843230.962561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843230.966167:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775781120 00000100:00100000:3.0:1788843230.966193:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775781120 00000100:00100000:3.0:1788843230.966298:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:3.0:1788843230.966310:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2359:x1875737775781120:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788843230.966791:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2359:x1875737775781120:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 480us (4244us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788843230.966824:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:3.0:1788843230.971825:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843230.974163:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775781376 00000100:00100000:1.0:1788843230.974179:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775781376 00000100:00100000:1.0:1788843230.974238:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:1.0:1788843230.974249:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+60:11526:x1875737775781376:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788843230.974541:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e778e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+61:11526:x1875737775781376:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 295us (2732us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788843230.974547:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:1.0:1788843230.979916:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843230.979968:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775781632 00000100:00100000:1.0:1788843230.979981:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775781632 00000100:00100000:1.0:1788843230.980058:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 180 00000100:00100000:1.0:1788843230.980073:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+61:11526:x1875737775781632:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788843230.980223:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73924380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+61:11526:x1875737775781632:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 154us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843230.980230:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 180 00000100:00100000:1.0:1788843230.983380:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843230.983461:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775781760 00000100:00100000:0.0:1788843230.983475:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775781760 00000100:00100000:0.0:1788843230.983557:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 181 00000100:00100000:0.0:1788843230.983571:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+61:11526:x1875737775781760:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843230.983595:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843230.983808:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09158ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084afd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.983908:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09158f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.983925:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09158f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.983937:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09158f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843230.983981:0:5846:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788843230.984003:0:5846:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09158f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.984033:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09158ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084afd expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.984054:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09158f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084afd expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843230.984065:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:0.0:1788843230.984077:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788843230.984083:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c5e00, rc 0) 00010000:00010000:2.0:1788843230.984131:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843230.984159:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+62:11526:x1875737775781760:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 591us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843230.984168:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 181 00000100:00100000:3.0:1788843230.993565:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843230.993721:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775781888 00000100:00100000:2.0:1788843230.993737:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775781888 00000100:00100000:2.0:1788843230.993865:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:2.0:1788843230.993878:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2358:x1875737775781888:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843230.993913:0:12070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843230.993941:0:12070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c639784/0xc6b8ac1b09158fb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b04 expref: -99 pid: 12070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788843230.993980:0:12070:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f94de, blocks: 0x1 00010000:00010000:2.0:1788843230.994010:0:12070:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=355s v=(0 0) 00010000:00010000:2.0:1788843230.994016:0:12070:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843230.994028:0:12070:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c639784/0xc6b8ac1b09158fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b04 expref: 8 pid: 12070 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.994050:0:12070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008c639784/0xc6b8ac1b09158fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b04 expref: 8 pid: 12070 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843230.994065:0:12070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375600, rc 0) 00000100:00100000:2.0:1788843230.994229:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e778a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2358:x1875737775781888:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 352us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843230.994238:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:0.0:1788843230.997070:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843230.998183:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775782144 00000100:00100000:1.0:1788843230.998202:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775782144 00000100:00100000:1.0:1788843230.998296:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 182 00000100:00100000:1.0:1788843230.998310:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+62:11526:x1875737775782144:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788843230.998673:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+62:11526:x1875737775782144:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 364us (1614us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843230.998683:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 182 00000100:00100000:1.0:1788843231.003211:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843231.003785:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775782272 00000100:00100000:3.0:1788843231.003798:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775782272 00000100:00100000:3.0:1788843231.003913:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:3.0:1788843231.003927:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+8:11526:x1875737775782272:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843231.003953:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843231.003976:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b0915902 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b0b expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.004017:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008c639784/0xc6b8ac1b09158fb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b04 expref: 9 pid: 12070 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.004028:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843231.004033:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843231.004039:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b0915902 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b0b expref: 9 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.004085:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008c639784/0xc6b8ac1b09158fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b04 expref: 9 pid: 12070 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.004103:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008c639784/0xc6b8ac1b09158fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b04 expref: 9 pid: 12070 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843231.004122:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e77b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6694:1875737795699712:192.168.203.29@tcp:104: 00000100:00100000:3.0:1788843231.004271:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab61fd1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843231.009262:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843231.009421:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e77b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6694:1875737795699712:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843231.009470:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b0915902 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b0b expref: 9 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.009600:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799ec00, rc 0) 00000100:00100000:3.0:1788843231.009761:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73924e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+9:11526:x1875737775782272:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 5836us (6563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843231.009772:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:0.0:1788843231.009908:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775782400 00000100:00100000:0.0:1788843231.009918:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775782400 00010000:00010000:0.0:1788843231.009966:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008c639784/0xc6b8ac1b09158fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b04 expref: 9 pid: 12070 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843231.010004:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 70 00000100:00100000:0.0:1788843231.010016:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+9:2359:x1875737775782400:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843231.010035:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843231.010066:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008c639784/0xc6b8ac1b09158fb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b04 expref: 9 pid: 12070 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.010083:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008c639784/0xc6b8ac1b09158fb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b04 expref: 9 pid: 12070 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.010114:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c639784/0xc6b8ac1b09158fb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b04 expref: 9 pid: 12070 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.010134:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843231.010140:0:6708:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843231.010150:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b0915902 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b0b expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.010176:0:6708:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b0915902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b0b expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.010226:0:6708:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b0915902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b0b expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843231.010248:0:6708:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42c26300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6708:1875737795699840:192.168.203.29@tcp:105: 00000100:00100000:0.0:1788843231.010325:0:6708:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41aeb000 going to sleep for 11 seconds 00000100:00100000:1.0:1788843231.015422:0:6708:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42c26300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6708:1875737795699840:192.168.203.29@tcp:105: 00010000:00010000:1.0:1788843231.015461:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843231.016533:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2359:x1875737775782400:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 6507us (7278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843231.016560:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 70 00000100:00100000:1.0:1788843231.016929:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843231.017615:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775782528 00000100:00100000:3.0:1788843231.017627:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775782528 00002000:00100000:3.0:1788843231.017908:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8daa42aeed80 x1875737775782528/t0(0) o4->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:602/0 lens 504/0 e 0 to 0 dl 1788843242 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788843231.017923:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8daa42aeed80 with x1875737775782528 ext(0->8) 00002000:00010000:3.0:1788843231.017931:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8daa42aeed80 00000100:00100000:3.0:1788843231.017978:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:3.0:1788843231.017989:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2358:x1875737775782528:12345-192.168.203.29@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788843231.019500:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aeed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+10:2358:x1875737775782528:12345-192.168.203.29@tcp:4:lhsmtool_posix.0 Request processed in 1500us (2561us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788843231.019514:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00002000:00100000:3.0:1788843231.019526:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8daa42aeed80 x1875737775782528/t4294967314(0) o4->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:602/0 lens 504/448 e 0 to 0 dl 1788843242 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788843231.019536:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8daa42aeed80 with x1875737775782528 ext(0->8) 00002000:00010000:3.0:1788843231.019542:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8daa42aeed80 00000100:00100000:1.0:1788843231.030223:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843231.030415:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775782656 00000100:00100000:3.0:1788843231.030433:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775782656 00000100:00100000:3.0:1788843231.030562:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 183 00000100:00100000:3.0:1788843231.030577:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+62:11526:x1875737775782656:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 00000100:00080000:0.0:1788843231.031098:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843231.073722:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+62:11526:x1875737775782656:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 Request processed in 42867us (43231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843231.073742:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 183 00000001:00080000:0.0:1788843231.073798:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967448 is committed 00000004:00080000:0.0:1788843231.073815:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:0.0:1788843231.073848:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8daa41aebf00 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1788843231.073853:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dab51450600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8daa41aeb780 00000020:00080000:0.0:1788843231.073857:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dab51450a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dab77737400 00000001:00080000:0.0:1788843231.073884:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:0.0:1788843231.073927:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788843231.074038:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:3.0:1788843231.074911:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795700096:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788843231.074998:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843231.075336:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795700096 00000100:00100000:1.0:1788843231.075369:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795700096 00000020:00080000:0.0:1788843231.075388:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788843231.075400:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843231.075412:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795699968:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788843231.075428:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788843231.075440:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795700096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788843231.075790:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843231.075859:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795699968 00000100:00100000:0.0:1788843231.075865:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795699968 00000100:00100000:0.0:1788843231.075918:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788843231.075927:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1875737795699968:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788843231.075947:0:8216:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1788843231.075989:0:8216:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f94db, atime: 0x6a9f94db, ctime: 0x6a9f94db, blocks: 0x1 00010000:00010000:0.0:1788843231.076000:0:8216:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a39731dc/0xc6b8ac1b0915909 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.076025:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=355s v=(0 0) 00010000:00010000:0.0:1788843231.076030:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843231.076038:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a39731dc/0xc6b8ac1b0915909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.076058:0:8216:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a39731dc/0xc6b8ac1b0915909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.076070:0:8216:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a39731dc/0xc6b8ac1b0915909 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.076080:0:8216:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a39731dc/0xc6b8ac1b0915909 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.076101:0:8216:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788843231.077488:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788843231.077692:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788843231 00002000:00010000:1.0:1788843231.077695:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788843231.077698:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788843230 -> 1788843231 00002000:00010000:1.0:1788843231.077700:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788843231.077801:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e779880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875737795700096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2361us (2802us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788843231.077812:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:3.0:1788843231.078171:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8daa42aefb80/2, rc 0, transno 4294967315 00000004:00080000:1.0:1788843231.078180:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dab6e77b800/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788843231.078181:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795700096:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788843231.078185:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e77b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795699968:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788843231.078401:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1875737795699968:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2213us (2348us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788843231.078413:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788843231.078588:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788843231.078619:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843231.078638:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a39731dc/0xc6b8ac1b0915909 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.078652:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843231.078658:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a39731dc/0xc6b8ac1b0915909 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.078671:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a39731dc/0xc6b8ac1b0915909 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.078872:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a39731dc/0xc6b8ac1b0915909 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.078882:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a39731dc/0xc6b8ac1b0915909 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.078916:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843231.078918:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843231.078920:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843231.079749:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843231.079834:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775782784 00000100:00100000:3.0:1788843231.079844:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775782784 00000100:00100000:3.0:1788843231.079911:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:3.0:1788843231.079925:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+10:2359:x1875737775782784:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 00000040:00080000:1.0:1788843231.100462:0:12513:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788843231.100478:0:12513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843231.100536:0:12513:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1788843231.100544:0:12513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788843231.142556:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+10:2359:x1875737775782784:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 Request processed in 62374us (62552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843231.142575:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 55 00000001:00080000:3.0:1788843231.142635:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:3.0:1788843231.142651:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:2.0:1788843231.147067:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843231.147129:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775783040 00000100:00100000:2.0:1788843231.147142:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775783040 00000100:00100000:2.0:1788843231.147232:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 184 00000100:00100000:2.0:1788843231.147243:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+18:11526:x1875737775783040:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788843231.147329:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843231.147389:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09158f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084afd expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.147412:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:2.0:1788843231.147419:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843231.147473:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915910 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.147494:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915910 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.147506:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915910 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843231.149502:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051ba17db reply state 000000006862d637 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915910 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843231.149524:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788843231.150108:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+19:11526:x1875737775783040:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 2856us (3056us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1788843231.150121:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 184 00010000:00010000:2.0:1788843231.151748:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915910 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.151769:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915910 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.151778:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915910 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.151784:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843231.151790:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915910 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.151798:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915910 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.151820:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:2.0:1788843231.151824:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843231.151830:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915910 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.151837:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915910 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843231.155368:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843231.155482:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775783168 00000100:00100000:1.0:1788843231.155499:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775783168 00000100:00100000:1.0:1788843231.155588:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:1.0:1788843231.155601:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2359:x1875737775783168:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788843231.155994:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788843231.156000:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788843231 -> 1788843229 00002000:00010000:1.0:1788843231.156003:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788843227 00002000:00010000:1.0:1788843231.156006:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788843231 -> 1788843229 00002000:00010000:1.0:1788843231.156009:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788843231.156117:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c141c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2359:x1875737775783168:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 517us (790us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788843231.156129:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:3.0:1788843231.162866:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843231.163023:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775783424 00000100:00100000:1.0:1788843231.163041:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775783424 00000100:00100000:1.0:1788843231.163147:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 185 00000100:00100000:1.0:1788843231.163161:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+18:11526:x1875737775783424:12345-192.168.203.29@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788843231.163284:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915917 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.163320:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09158d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084aef expref: 18 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.163334:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915917 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.163406:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09158d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084aef expref: 18 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.163657:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09158d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084aef expref: 18 pid: 7168 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843231.163713:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aed180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795700224:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843231.163875:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7793a480 going to sleep for 11 seconds 00000100:00100000:1.0:1788843231.166829:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843231.166872:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775783552 00000100:00100000:1.0:1788843231.166896:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775783552 00010000:00010000:1.0:1788843231.166958:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09158d8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084aef expref: 19 pid: 7168 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843231.167005:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 71 00000100:00100000:3.0:1788843231.167083:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aed180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795700224:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843231.167121:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915917 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843231.167183:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+19:2359:x1875737775783552:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843231.167207:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843231.167218:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09158d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084aef expref: 19 pid: 7168 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.167232:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09158d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084aef expref: 19 pid: 7168 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.167263:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b09158d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084aef expref: 19 pid: 7168 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.167312:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:1.0:1788843231.167318:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915917 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.167330:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.167395:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915917 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.167433:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843231.167630:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aedf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+18:2359:x1875737775783552:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 613us (813us total) trans 0 rc 0/0 00010000:00010000:3.0:1788843231.167877:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.167898:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.167946:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915917 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.167955:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915917 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.167963:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915917 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.167969:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843231.167974:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915917 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.167983:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915917 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.167994:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:3.0:1788843231.167997:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788843231.168001:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915917 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.168008:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915917 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843231.168073:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+18:11526:x1875737775783424:12345-192.168.203.29@tcp:55:lhsmtool_posix.0 Request processed in 4915us (5224us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788843231.168084:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 185 00000100:00100000:3.0:1788843231.172188:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843231.172663:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775783680 00000100:00100000:0.0:1788843231.172680:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775783680 00000100:00100000:0.0:1788843231.172758:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:0.0:1788843231.172772:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2357:x1875737775783680:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788843231.172879:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b091591e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.172924:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b0915902 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b0b expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.172937:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843231.172942:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788843231.172949:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b091591e lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.173009:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b0915902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b0b expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.173029:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b0915902 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b0b expref: 8 pid: 6694 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843231.173051:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42c24700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1875737795700352:192.168.203.29@tcp:104: 00000100:00100000:0.0:1788843231.173182:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41adaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843231.175999:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 71 00000100:00100000:3.0:1788843231.180331:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843231.180388:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775783808 00000100:00100000:3.0:1788843231.180411:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775783808 00010000:00010000:3.0:1788843231.180464:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b0915902 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b0b expref: 9 pid: 6694 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843231.180518:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 72 00000100:00100000:3.0:1788843231.180530:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+9:2358:x1875737775783808:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843231.180548:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843231.180579:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b0915902 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b0b expref: 9 pid: 6694 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843231.180599:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42c24700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1875737795700352:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843231.180600:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b0915902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b0b expref: 9 pid: 6694 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.180635:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b0915902 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b0b expref: 9 pid: 6694 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.180638:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b091591e lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.180654:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843231.180925:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843231.180932:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b091591e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.180944:0:7638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b091591e lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.181043:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843231.181121:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2358:x1875737775783808:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 590us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843231.181139:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 72 00010000:00010000:0.0:1788843231.182035:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b091591e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.182055:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b091591e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.182108:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b091591e lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.182118:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b091591e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.182128:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b091591e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.182135:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843231.182142:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b091591e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.182154:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b091591e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.182175:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b091591e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.182203:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b091591e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843231.182546:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e778000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2357:x1875737775783680:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 Request processed in 9772us (10373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843231.182558:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:3.0:1788843231.187728:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843231.188130:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775784064 00000100:00100000:2.0:1788843231.188149:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775784064 00000100:00100000:2.0:1788843231.188257:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 186 00000100:00100000:2.0:1788843231.188272:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+17:11526:x1875737775784064:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788843231.188479:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915925 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.188524:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915925 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.188539:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915925 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.189031:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b091592c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.189046:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09158e6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084af6 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.189056:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b091592c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.189115:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09158e6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084af6 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.189134:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09158e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084af6 expref: 18 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843231.189156:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c143100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1875737795700480:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843231.189313:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab436f1540 going to sleep for 11 seconds 00000100:00100000:3.0:1788843231.194454:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843231.194977:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775784192 00000100:00100000:2.0:1788843231.194990:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775784192 00010000:00010000:2.0:1788843231.195050:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09158e6 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084af6 expref: 19 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843231.195102:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 73 00000100:00100000:2.0:1788843231.195136:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e779f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+19:2358:x1875737775784192:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843231.195163:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843231.195172:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09158e6 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084af6 expref: 19 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.195191:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09158e6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084af6 expref: 19 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.195224:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:2.0:1788843231.195231:0:6708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b091592c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.195244:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b091592c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.195253:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b091592c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.195285:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843231.195971:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e779f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+19:2358:x1875737775784192:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 290us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843231.195983:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 73 00010000:00010000:2.0:1788843231.196081:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09158e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084af6 expref: 18 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843231.196106:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c143100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1875737795700480:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843231.196135:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b091592c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.196163:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b091592c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843231.196169:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b091592c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788843231.201749:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1788843231.202029:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1788843231.202082:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1788843231.202216:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e77a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1875737795700608:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788843231.202330:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843231.202436:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41aeb000 going to sleep for 11 seconds 00000100:00100000:1.0:1788843231.202500:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795700608 00000100:00100000:1.0:1788843231.202512:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795700608 00000100:00100000:1.0:1788843231.202586:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788843231.202599:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1875737795700608:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788843231.202717:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e779500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1875737795700608:12345-0@lo:1000:mdt00_001.0 Request processed in 119us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843231.202725:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788843231.202976:0:5847:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1788843231.202984:0:5847:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8daa42aefb80, transno 4294967315 00000100:00100000:3.0:1788843231.203007:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e77a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1875737795700608:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788843231.203978:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1788843231.204066:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e77a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1875737795700736:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788843231.204147:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843231.204191:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41aeb840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843231.204332:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795700736 00000100:00100000:2.0:1788843231.204367:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795700736 00000100:00100000:2.0:1788843231.204416:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843231.204642:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875737795700736:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788843231.205032:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5847:x1875737795700736:12345-0@lo:1000:mdt00_001.0 Request processed in 394us (885us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788843231.205119:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e77a300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5847:1875737795700736:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788843231.205165:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b091592c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.205177:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b091592c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.205186:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b091592c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.205193:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375600 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843231.205210:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b091592c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.205219:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b091592c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.205240:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:3.0:1788843231.205243:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843231.205248:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b091592c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.205255:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b091592c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.205604:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915861 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.205614:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915861 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.205625:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915861 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.205632:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374600 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843231.205635:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915861 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.205640:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915861 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.205650:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910600) 00010000:00010000:3.0:1788843231.205653:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843231.205664:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915861 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.205670:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915861 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.205734:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915933 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.205752:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091587d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ada expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.205762:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915933 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.205798:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091587d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ada expref: 21 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.205814:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091587d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ada expref: 21 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843231.205988:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e778700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1875737795700864:192.168.203.29@tcp:104: 00000100:00100000:3.0:1788843231.206103:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41aeb840 going to sleep for 11 seconds 00000100:00100000:2.0:1788843231.207615:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788843231.218577:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e778700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1875737795700864:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843231.218624:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915933 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843231.219256:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843231.219336:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775784320 00000100:00100000:1.0:1788843231.219374:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775784320 00010000:00010000:1.0:1788843231.219441:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091587d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ada expref: 22 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843231.219490:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 74 00000100:00100000:1.0:1788843231.219503:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+22:2358:x1875737775784320:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843231.219524:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843231.219533:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091587d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ada expref: 22 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.219549:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091587d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ada expref: 22 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.219589:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091587d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ada expref: 22 pid: 5846 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.219609:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910600) 00010000:00010000:1.0:1788843231.219616:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915933 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.219629:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915933 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.219651:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915933 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843231.222988:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843231.223122:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c143100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+21:2358:x1875737775784320:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 3604us (3968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843231.223139:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 74 00010000:00010000:3.0:1788843231.228607:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915933 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.228625:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915933 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.228646:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915933 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.228680:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915933 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.228689:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915933 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.228697:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799ea00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843231.228704:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915933 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.228714:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915933 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.228743:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910600) 00010000:00010000:3.0:1788843231.228748:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843231.228756:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915933 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.228763:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915933 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.228782:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915925 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.228789:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915925 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.228796:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915925 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.228801:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843231.228825:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915925 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.228832:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915925 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.228842:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910600) 00010000:00010000:3.0:1788843231.228844:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788843231.228847:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915925 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.228853:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915925 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843231.229266:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e779180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+20:11526:x1875737775784064:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 40989us (41554us total) trans 4294967467 rc 0/0 00000100:00100000:3.0:1788843231.229282:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 186 00000020:00080000:3.0:1788843231.229291:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788843231.231049:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788843231.231061:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843231.231587:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788843231.231595:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788843231.232246:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843231.232492:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775784576 00000100:00100000:1.0:1788843231.232506:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775784576 00000100:00100000:1.0:1788843231.232575:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:1.0:1788843231.232589:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6640e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+20:11526:x1875737775784576:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788843231.233314:0:5850:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788843231.239932:0:5850:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:0.0:1788843231.240043:0:5850:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b091593a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.240066:0:5850:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b091593a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.240082:0:5850:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b091593a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.240092:0:5850:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b091593a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.240101:0:5850:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b091593a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.240107:0:5850:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b091593a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843231.240136:0:5850:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788843231.240324:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6640e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+22:11526:x1875737775784576:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 7730us (8079us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1788843231.240379:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 50 00000020:00080000:0.0:1788843231.240386:0:5850:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788843231.240779:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843231.240789:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b091593a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.240799:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4e00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843231.240805:0:7637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b091593a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.240816:0:7637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b091593a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.240834:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dab43ece900) 00010000:00010000:3.0:1788843231.240837:0:7637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788843231.240850:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b091593a lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.240857:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b091593a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5850 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843231.240882:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843231.240896:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843231.240898:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843231.559214:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795701376:0@lo:400:kworker.0 00000100:00100000:0.0:1788843231.559214:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795700992:0@lo:400:kworker.0 00000100:00100000:0.0:1788843231.559490:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843231.559832:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795701120:0@lo:400:kworker.0 00000100:00100000:0.0:1788843231.559873:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843231.559911:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843231.559918:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795701248:0@lo:400:kworker.0 00000100:00100000:0.0:1788843231.559942:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843231.559977:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795701120 00000100:00100000:0.0:1788843231.559987:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795701120 00000100:00100000:0.0:1788843231.560052:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795701248 00000100:00100000:0.0:1788843231.560055:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795701248 00000100:00100000:0.0:1788843231.560092:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788843231.560102:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795701120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843231.560464:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795701120:12345-0@lo:400:kworker.0 Request processed in 360us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843231.560473:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788843231.560493:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788843231.560500:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795701248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843231.560531:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795701248:12345-0@lo:400:kworker.0 Request processed in 32us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843231.560538:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1788843231.560555:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843231.560633:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795701248:0@lo:400:kworker.0 00000100:00100000:0.0:1788843231.560829:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795701120:0@lo:400:kworker.0 00000100:00100000:0.0:1788843231.561020:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795700992 00000100:00100000:0.0:1788843231.561026:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795700992 00000100:00100000:0.0:1788843231.561062:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788843231.561069:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795700992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843231.561117:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795700992:12345-0@lo:400:kworker.0 Request processed in 48us (1629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843231.561123:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788843231.561568:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795700992:0@lo:400:kworker.0 00000100:00100000:3.0:1788843231.571004:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843231.571068:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795701376 00000100:00100000:0.0:1788843231.571082:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795701376 00000100:00080000:3.0:1788843231.571158:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843231.572777:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788843231.572798:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795701376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843231.572935:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e778380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795701376:12345-0@lo:400:kworker.0 Request processed in 145us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843231.572944:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788843231.573429:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795701376:0@lo:400:kworker.0 00000001:00080000:1.0:1788843231.709816:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1788843231.709855:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00010000:00010000:2.0:1788843232.005379:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843232.069940:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843232.069963:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795701504:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843232.070031:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843232.070254:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795701504 00000100:00100000:1.0:1788843232.070264:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795701504 00000100:00100000:1.0:1788843232.070322:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788843232.070333:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795701504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843232.070408:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843232.070468:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e778e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795701504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843232.070476:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788843232.070791:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1788843232.070797:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:3.0:1788843232.070816:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dab6e77b800, transno 4294967307 00000100:00100000:3.0:1788843232.070839:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795701504:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788843233.028896:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788843233.158498:0:12569:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788843233.158516:0:12569:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788843233.158575:0:12569:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788843233.158583:0:12569:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788843233.312015:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843233.312432:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775784832 00000100:00100000:2.0:1788843233.312447:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775784832 00000100:00100000:2.0:1788843233.312546:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 187 00000100:00100000:2.0:1788843233.312565:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+22:11544:x1875737775784832:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843233.312612:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843233.312649:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915941 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b12 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.312855:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b0915948 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.312886:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b0915948 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788843233.313228:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788843233.313616:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b0915948 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843233.313643:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788843233.314126:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915941 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b12 expref: 25 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.314164:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b0915948 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b12 expref: 24 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.314173:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843233.314185:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788843233.314193:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375400, rc 0) 00000100:00100000:2.0:1788843233.314286:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+24:11544:x1875737775784832:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1728us (2295us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788843233.314295:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 187 00000100:00100000:0.0:1788843233.319527:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843233.319739:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775784960 00000100:00100000:2.0:1788843233.319755:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775784960 00000100:00100000:2.0:1788843233.319845:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 188 00000100:00100000:2.0:1788843233.319859:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+24:11544:x1875737775784960:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:2.0:1788843233.319985:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915956 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.320018:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.320051:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.320076:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b091595d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.320083:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b091595d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.320090:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b091595d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.320505:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0915964 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.320515:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0915964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.320522:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0915964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788843233.320586:0:7168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0915964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.320603:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915956 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.320612:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915956 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321123:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915956 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321130:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843233.321135:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915956 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321144:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915956 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321163:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843233.321167:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843233.321172:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915956 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321180:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915956 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321269:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b091595d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321278:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b091595d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321285:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b091595d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321291:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843233.321295:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b091595d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321314:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b091595d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321323:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab54910a00) 00010000:00010000:2.0:1788843233.321325:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843233.321328:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b091595d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321336:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b091595d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321477:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0915964 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321542:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0915964 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321549:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0915964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321556:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843233.321559:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0915964 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321566:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0915964 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321575:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910200) 00010000:00010000:2.0:1788843233.321578:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843233.321581:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0915964 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.321596:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0915964 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843233.321853:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+24:11544:x1875737775784960:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 1992us (2338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843233.321865:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 188 00000100:00100000:1.0:1788843233.362909:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843233.363450:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775785216 00000100:00100000:2.0:1788843233.363468:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775785216 00000100:00100000:2.0:1788843233.363575:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 189 00000100:00100000:2.0:1788843233.363590:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+24:11547:x1875737775785216:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843233.363752:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843233.363785:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b091596b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b19 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.363909:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915972 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.363930:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915972 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.363944:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915972 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.363960:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915979 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.363967:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915979 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.363973:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915979 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365330:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915980 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365373:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365383:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915980 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843233.365395:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1788843233.365529:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915972 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365538:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915972 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365545:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915972 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365552:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843233.365557:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915972 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365565:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915972 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365580:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843233.365583:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843233.365588:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915972 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365594:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915972 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365644:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915979 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365651:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915979 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365657:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915979 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365662:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843233.365664:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915979 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365671:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915979 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365679:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab54910200) 00010000:00010000:2.0:1788843233.365682:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843233.365686:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915979 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365692:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915979 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365757:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b091596b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b19 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365778:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b19 expref: 26 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.365798:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910a00) 00010000:00010000:2.0:1788843233.365800:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843233.365803:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375200, rc 0) 00000100:00100000:2.0:1788843233.366775:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+26:11547:x1875737775785216:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 3180us (3872us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788843233.366786:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 189 00000100:00100000:0.0:1788843233.369799:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843233.370654:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775785344 00000100:00100000:2.0:1788843233.370670:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775785344 00000100:00100000:2.0:1788843233.370753:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 190 00000100:00100000:2.0:1788843233.370766:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+26:11547:x1875737775785344:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:2.0:1788843233.370854:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b091598e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.371127:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b091598e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.371146:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b091598e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.371181:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b091598e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.371189:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b091598e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.371197:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b091598e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.371204:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843233.371223:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b091598e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.371232:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b091598e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.371248:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910a00) 00010000:00010000:2.0:1788843233.371253:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843233.371259:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b091598e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.371267:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b091598e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843233.371448:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+26:11547:x1875737775785344:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 671us (1650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843233.371457:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 190 00000100:00100000:3.0:1788843233.374105:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843233.374205:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775785600 00000100:00100000:0.0:1788843233.374218:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775785600 00000100:00100000:0.0:1788843233.374303:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:0.0:1788843233.374316:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+26:11547:x1875737775785600:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:0.0:1788843233.374723:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+27:11547:x1875737775785600:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 408us (629us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788843233.374732:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:0.0:1788843233.423832:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843233.423962:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775785856 00000100:00100000:1.0:1788843233.423979:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775785856 00000100:00100000:1.0:1788843233.424078:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 191 00000100:00100000:1.0:1788843233.424093:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+27:11071:x1875737775785856:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:1.0:1788843233.424131:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843233.424170:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915995 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b20 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843233.424312:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091599c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843233.424710:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915980 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b19 expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843233.424724:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091599c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843233.424777:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915980 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b19 expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843233.424811:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915980 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b19 expref: 28 pid: 5847 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843233.424827:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aef100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795701632:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843233.425128:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7793a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788843233.430028:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843233.430107:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775785984 00000100:00100000:2.0:1788843233.430120:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775785984 00010000:00010000:2.0:1788843233.430176:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915980 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b19 expref: 29 pid: 5847 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843233.430226:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 75 00000100:00100000:2.0:1788843233.430239:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+29:2359:x1875737775785984:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843233.430260:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843233.430268:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915980 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b19 expref: 29 pid: 5847 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.430283:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915980 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b19 expref: 29 pid: 5847 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.430534:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910a00) 00010000:00010000:2.0:1788843233.430541:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091599c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.430553:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091599c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.430560:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091599c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.430584:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843233.430689:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+29:2359:x1875737775785984:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 451us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843233.430698:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 75 00010000:00010000:1.0:1788843233.431087:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915980 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b19 expref: 28 pid: 5847 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843233.431131:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aef100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795701632:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843233.431161:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091599c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843233.431177:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091599c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843233.431183:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091599c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843233.431209:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788843233.432411:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915995 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b20 expref: 29 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843233.432437:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091599c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b20 expref: 28 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843233.432448:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910a00) 00010000:00010000:1.0:1788843233.432463:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788843233.432467:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933a000, rc 0) 00000100:00100000:1.0:1788843233.432537:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+28:11071:x1875737775785856:12345-192.168.203.29@tcp:101:bash.0 Request processed in 8446us (8719us total) trans 4294967473 rc 0/0 00000100:00100000:1.0:1788843233.432547:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 191 00000100:00100000:2.0:1788843233.435644:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843233.435782:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775786240 00000100:00100000:0.0:1788843233.435796:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775786240 00000100:00100000:0.0:1788843233.435914:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 192 00000100:00100000:0.0:1788843233.435927:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+28:11071:x1875737775786240:12345-192.168.203.29@tcp:36:bash.0 00010000:00010000:0.0:1788843233.436287:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09159aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.436311:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09159aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.436502:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09159aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843233.436576:0:7168:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:0.0:1788843233.436606:0:7168:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5b2643e reply state 0000000075693f64 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09159aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843233.436616:0:7168:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788843233.436671:0:7168:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:0.0:1788843233.436809:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+32:11071:x1875737775786240:12345-192.168.203.29@tcp:36:bash.0 Request processed in 882us (1177us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1788843233.436818:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 192 00000020:00080000:0.0:1788843233.436824:0:7168:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788843233.439629:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09159aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.439653:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09159aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.439662:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09159aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.439691:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843233.439698:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09159aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.439709:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09159aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.439732:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910a00) 00010000:00010000:3.0:1788843233.439735:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843233.439741:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09159aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.439748:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b09159aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843233.440611:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843233.440708:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775786368 00000100:00100000:1.0:1788843233.440723:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775786368 00000100:00100000:1.0:1788843233.440803:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 193 00000100:00100000:1.0:1788843233.440816:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+31:11071:x1875737775786368:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:1.0:1788843233.440845:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843233.440883:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09159b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b27 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843233.440979:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09159b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b27 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843233.440995:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09159b1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b27 expref: 32 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843233.441020:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910a00) 00010000:00010000:1.0:1788843233.441023:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843233.441027:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b400, rc 0) 00000100:00100000:1.0:1788843233.441163:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+32:11071:x1875737775786368:12345-192.168.203.29@tcp:101:bash.0 Request processed in 349us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843233.441172:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 193 00000100:00100000:0.0:1788843233.449422:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843233.449702:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775786496 00000100:00100000:3.0:1788843233.449720:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775786496 00000100:00100000:3.0:1788843233.449822:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00100000:3.0:1788843233.449838:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:11071:x1875737775786496:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1788843233.449866:0:6694:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843233.449910:0:6694:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b09159b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b2e expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788843233.449953:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f94dd, atime: 0x6a9f94db, ctime: 0x6a9f94dd, blocks: 0xb 00010000:00010000:3.0:1788843233.449989:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1788843233.449995:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843233.450007:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b09159b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b2e expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.450043:0:6694:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b09159b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b2e expref: 8 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.450060:0:6694:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799ec00, rc 0) 00000100:00100000:3.0:1788843233.450140:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+8:11071:x1875737775786496:12345-192.168.203.29@tcp:101:bash.0 Request processed in 307us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843233.450149:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00080000:0.0:1788843233.451934:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843233.454701:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843233.454949:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775786624 00000100:00100000:2.0:1788843233.454961:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775786624 00002000:00010000:2.0:1788843233.455031:0:6699:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788843233.455038:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8daa42c24a80 with x1875737775786624 ext(0->18446744073709551615) 00002000:00010000:2.0:1788843233.455054:0:6699:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8daa42c24a80. 00000100:00100000:2.0:1788843233.455106:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:2.0:1788843233.455118:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2358:x1875737775786624:12345-192.168.203.29@tcp:10:bash.0 00002000:00010000:2.0:1788843233.455620:0:6699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788843233.455626:0:6699:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788843229 -> 1788843233 00002000:00010000:2.0:1788843233.455629:0:6699:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788843227 -> 1788843227 00002000:00010000:2.0:1788843233.455632:0:6699:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788843229 -> 1788843233 00002000:00010000:2.0:1788843233.455653:0:6699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788843233.455752:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c24a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+9:2358:x1875737775786624:12345-192.168.203.29@tcp:10:bash.0 Request processed in 634us (1066us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788843233.455761:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00002000:00010000:2.0:1788843233.455766:0:6699:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:2.0:1788843233.455770:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8daa42c24a80 with x1875737775786624 ext(0->18446744073709551615) 00002000:00010000:2.0:1788843233.455775:0:6699:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8daa42c24a80. 00000100:00100000:2.0:1788843233.557635:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843233.559481:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775786752 00000100:00100000:0.0:1788843233.559510:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775786752 00000100:00100000:0.0:1788843233.559621:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 194 00000100:00100000:0.0:1788843233.559644:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+32:11561:x1875737775786752:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:0.0:1788843233.559774:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09159bf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.559798:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09159bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.559814:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09159bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.559834:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09159c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.559843:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09159c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.559850:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09159c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.560633:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.560652:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.560662:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788843233.560735:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.560749:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09159bf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.560757:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09159bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.560884:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09159bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.560892:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843233.560897:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09159bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.560906:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09159bf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.560922:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:0.0:1788843233.560926:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843233.560931:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09159bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.560937:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b09159bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.560957:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09159c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.560963:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09159c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.560976:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09159c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.560981:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843233.560984:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09159c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.560990:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09159c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.560997:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab43ece700) 00010000:00010000:0.0:1788843233.560999:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843233.561002:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09159c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.561007:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b09159c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.561026:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.561032:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.561038:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.561043:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843233.561045:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.561061:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.561068:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910a00) 00010000:00010000:0.0:1788843233.561070:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843233.561074:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159cd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.561080:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843233.561618:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+32:11561:x1875737775786752:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 1974us (3995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843233.561631:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 194 00000100:00100000:0.0:1788843233.640609:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843233.640746:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775787008 00000100:00100000:3.0:1788843233.640763:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775787008 00000100:00100000:3.0:1788843233.640895:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 195 00000100:00100000:3.0:1788843233.640913:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+32:11564:x1875737775787008:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843233.640949:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843233.640982:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b09159d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b35 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.641100:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b09159db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.641123:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b09159db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.641142:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b09159db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.641456:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09159e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.641493:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09159e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.641502:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09159e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.643372:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b09159e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.643402:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b09159e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.643417:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b09159e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843233.643507:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788843233.643703:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b09159db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.643714:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b09159db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.643723:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b09159db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.643732:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799f600 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843233.643738:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b09159db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.643748:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b09159db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.643792:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:3.0:1788843233.643796:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843233.643802:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b09159db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.643810:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b09159db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.643831:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09159e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.643837:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09159e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.645047:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09159e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.645058:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799e000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843233.645064:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09159e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.645076:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09159e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.645096:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab43e63500) 00010000:00010000:3.0:1788843233.645100:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843233.645104:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09159e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.645113:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b09159e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.645259:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b09159d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b35 expref: 35 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.645291:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b09159e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b35 expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.645302:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910a00) 00010000:00010000:3.0:1788843233.645305:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788843233.645308:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799fe00, rc 0) 00000100:00100000:3.0:1788843233.645465:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+34:11564:x1875737775787008:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 4553us (4881us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788843233.645479:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 195 00000100:00100000:1.0:1788843233.650005:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843233.651625:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775787136 00000100:00100000:0.0:1788843233.651651:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775787136 00000100:00100000:0.0:1788843233.651780:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 196 00000100:00100000:0.0:1788843233.651795:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+34:11564:x1875737775787136:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:0.0:1788843233.651939:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.651966:0:7168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091599c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b20 expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.651978:0:7168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159f7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.652038:0:7168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091599c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b20 expref: 34 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.652084:0:7168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091599c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b20 expref: 34 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843233.652108:0:7168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42c25880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7168:1875737795701760:192.168.203.29@tcp:104: 00000100:00100000:0.0:1788843233.653619:0:7168:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4936a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843233.657505:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843233.657888:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775787392 00000100:00100000:3.0:1788843233.657905:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775787392 00000100:00100000:3.0:1788843233.657998:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:3.0:1788843233.658015:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+35:5595:x1875737775787392:12345-192.168.203.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788843233.658327:0:7168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42c25880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7168:1875737795701760:192.168.203.29@tcp:104: 00010000:00010000:0.0:1788843233.658388:0:7168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843233.659092:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+36:5595:x1875737775787392:12345-192.168.203.29@tcp:35:ldlm_bl.0 Request processed in 1077us (1603us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788843233.659105:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:1.0:1788843233.673084:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843233.673243:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775787520 00000100:00100000:2.0:1788843233.673259:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775787520 00010000:00010000:2.0:1788843233.673322:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091599c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b20 expref: 36 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843233.673479:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 76 00000100:00100000:2.0:1788843233.673490:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4886c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+36:2358:x1875737775787520:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843233.673516:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843233.673524:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091599c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b20 expref: 36 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.673554:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091599c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b20 expref: 36 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.673593:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b091599c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b20 expref: 36 pid: 5846 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.673619:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910a00) 00010000:00010000:2.0:1788843233.673627:0:6708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.673661:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.673671:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159f7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.673770:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843233.673856:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4886c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+35:2358:x1875737775787520:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 367us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843233.673866:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 76 00010000:00010000:0.0:1788843233.674299:0:7168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.674311:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.674474:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.674483:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.674491:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.674498:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843233.674504:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.674513:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.674536:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910a00) 00010000:00010000:0.0:1788843233.674539:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788843233.674544:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.674550:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b09159f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843233.674665:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+34:11564:x1875737775787136:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 22872us (24677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843233.674676:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 196 00000100:00100000:1.0:1788843233.681718:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843233.683131:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775787776 00000100:00100000:3.0:1788843233.683158:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775787776 00000100:00100000:3.0:1788843233.684207:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:3.0:1788843233.684231:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+34:11564:x1875737775787776:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:3.0:1788843233.684652:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+35:11564:x1875737775787776:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 428us (2951us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788843233.684967:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:1.0:1788843233.813108:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843233.813446:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775788032 00000100:00100000:2.0:1788843233.813468:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775788032 00000100:00100000:2.0:1788843233.813579:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 197 00000100:00100000:2.0:1788843233.813592:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+35:11575:x1875737775788032:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:2.0:1788843233.813631:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843233.813664:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b09159fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b3c expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.813781:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915a05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.813802:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915a05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.813822:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915a05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.813840:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915a0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.814837:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.814849:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818397:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b0915a13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818430:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b0915a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818445:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b0915a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843233.818461:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1788843233.818642:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915a05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818654:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915a05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818662:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915a05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818670:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843233.818676:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915a05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818686:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915a05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818732:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843233.818735:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843233.818742:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915a05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818750:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915a05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818796:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915a0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818804:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915a0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818810:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818816:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843233.818819:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915a0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818826:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915a0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818833:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab54910200) 00010000:00010000:2.0:1788843233.818836:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843233.818839:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915a0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818845:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915a0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818966:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b09159fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b3c expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818989:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b0915a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b3c expref: 37 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.818997:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910a00) 00010000:00010000:2.0:1788843233.818999:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843233.819003:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375800, rc 0) 00000100:00100000:2.0:1788843233.820959:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+37:11575:x1875737775788032:12345-192.168.203.29@tcp:101:cat.0 Request processed in 7341us (7842us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788843233.821094:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 197 00000100:00100000:0.0:1788843233.828515:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843233.829743:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775788288 00000100:00100000:2.0:1788843233.829779:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775788288 00000100:00100000:2.0:1788843233.829963:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:2.0:1788843233.829979:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+37:11575:x1875737775788288:12345-192.168.203.29@tcp:35:cat.0 00000100:00100000:2.0:1788843233.830922:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+38:11575:x1875737775788288:12345-192.168.203.29@tcp:35:cat.0 Request processed in 938us (2426us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788843233.830936:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 54 00000100:00100000:1.0:1788843233.875140:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843233.875440:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775788544 00000100:00100000:0.0:1788843233.875456:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775788544 00000100:00100000:0.0:1788843233.875556:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 198 00000100:00100000:0.0:1788843233.875569:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+38:11576:x1875737775788544:12345-192.168.203.29@tcp:36:rm.0 00010000:00010000:0.0:1788843233.875896:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788843233.875940:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b0915a13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b3c expref: 38 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.875990:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b09159e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b35 expref: 37 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.876006:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b09159b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b27 expref: 36 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.876025:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab54910a00) 00010000:00010000:0.0:1788843233.876069:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843233.876105:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915a21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.877360:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915a21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.877389:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915a21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.877420:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915a28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.877431:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.877439:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.877840:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915a2f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.877850:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915a2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.877858:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915a2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843233.879296:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1788843233.879318:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358129975601ns, next at 359129971034ns, rc = 0 00010000:00010000:0.0:1788843233.879437:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915a36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879468:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915a36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879480:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915a36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879490:0:5848:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915a36 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879497:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915a36 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879504:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915a36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879593:0:5848:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843233.879691:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915a2f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879698:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915a2f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879704:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915a2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879712:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843233.879719:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915a2f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879727:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915a2f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879755:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab43ecee00) 00010000:00010000:0.0:1788843233.879758:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788843233.879765:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915a2f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879772:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915a2f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879796:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915a21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879802:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915a21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879809:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915a21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879814:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843233.879817:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915a21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879823:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915a21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879829:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:0.0:1788843233.879831:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843233.879834:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915a21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843233.879840:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915a21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788843233.879860:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000072582d66 reply state 000000005958c7d0 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843233.879884:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788843233.880032:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+37:11576:x1875737775788544:12345-192.168.203.29@tcp:36:rm.0 Request processed in 4459us (4915us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788843233.880046:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 198 00010000:00010000:1.0:1788843233.882537:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843233.882559:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915a36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843233.882574:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843233.882581:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915a36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843233.882596:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915a36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843233.882621:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dab43ecee00) 00010000:00010000:1.0:1788843233.882625:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788843233.882632:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915a36 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843233.882639:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915a36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843233.882749:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843233.882752:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843233.882754:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843233.887086:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915a28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.887116:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915a28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.887136:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915a28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.887173:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843233.887180:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915a28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.887189:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915a28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.887217:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab43ece700) 00010000:00010000:2.0:1788843233.887221:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843233.887228:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915a28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.887235:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915a28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843233.970607:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843233.970811:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775788800 00000100:00100000:3.0:1788843233.970830:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775788800 00000100:00100000:3.0:1788843233.971238:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 199 00000100:00100000:3.0:1788843233.971256:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+36:11582:x1875737775788800:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1788843233.971315:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843233.971403:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915a3d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b43 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.971603:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915a44 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.971640:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915a44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.971655:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915a44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.971675:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b0915a4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.971683:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b0915a4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.971690:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b0915a4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788843233.972518:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788843233.974125:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915a52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.974166:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.974181:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915a52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.974235:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915a44 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.974244:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915a44 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.974252:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915a44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.974259:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799e000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843233.974264:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915a44 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.974273:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915a44 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.974374:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:3.0:1788843233.974377:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843233.974383:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915a44 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.974391:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915a44 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843233.974409:0:5846:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065e77a9d reply state 00000000dd1029de transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b0915a4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843233.974426:0:5846:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788843233.974534:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915a3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b43 expref: 39 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.974553:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b43 expref: 38 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.974561:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab43e63200) 00010000:00010000:3.0:1788843233.974563:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843233.974566:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799e200, rc 0) 00000100:00100000:3.0:1788843233.974876:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+39:11582:x1875737775788800:12345-192.168.203.29@tcp:101:bash.0 Request processed in 3614us (4272us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788843233.974888:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 199 00010000:00010000:3.0:1788843233.979795:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b0915a4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.979824:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b0915a4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.979832:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b0915a4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.979838:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799f600 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843233.979844:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b0915a4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.979855:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b0915a4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.979917:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab43e63500) 00010000:00010000:3.0:1788843233.979921:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843233.979927:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b0915a4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843233.979935:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f600/0xc6b8ac1b0915a4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843233.984827:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843233.985582:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775788928 00000100:00100000:3.0:1788843233.985600:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775788928 00000100:00100000:2.0:1788843233.985847:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:2.0:1788843233.985862:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2358:x1875737775788928:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1788843233.985903:0:8216:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843233.985940:0:8216:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bef1bd45/0xc6b8ac1b0915a60 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b4a expref: -99 pid: 8216 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788843233.985990:0:8216:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788843233.986024:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1788843233.986029:0:8216:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843233.986042:0:8216:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bef1bd45/0xc6b8ac1b0915a60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b4a expref: 6 pid: 8216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.986071:0:8216:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bef1bd45/0xc6b8ac1b0915a60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b4a expref: 6 pid: 8216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.986118:0:8216:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374800, rc 0) 00000100:00100000:2.0:1788843233.986238:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775788928:12345-192.168.203.29@tcp:101:bash.0 Request processed in 379us (1437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843233.986247:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00080000:0.0:1788843233.989137:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788843233.995799:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843233.999139:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775789056 00000100:00100000:2.0:1788843233.999168:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775789056 00000100:00100000:2.0:1788843233.999419:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:2.0:1788843233.999434:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+6:11582:x1875737775789056:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1788843233.999460:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843233.999560:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f0239d0/0xc6b8ac1b0915a67 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b51 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.999614:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bef1bd45/0xc6b8ac1b0915a60 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b4a expref: 7 pid: 8216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.999625:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843233.999630:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843233.999637:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f0239d0/0xc6b8ac1b0915a67 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b51 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.999685:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bef1bd45/0xc6b8ac1b0915a60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b4a expref: 7 pid: 8216 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843233.999700:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bef1bd45/0xc6b8ac1b0915a60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b4a expref: 7 pid: 8216 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843233.999741:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c143100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1875737795701888:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843233.999964:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa1e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788843234.010918:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843234.011006:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c143100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6692:1875737795701888:192.168.203.29@tcp:104: 00000100:00100000:3.0:1788843234.011020:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775789184 00000100:00100000:3.0:1788843234.011031:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775789184 00010000:00010000:2.0:1788843234.011057:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001f0239d0/0xc6b8ac1b0915a67 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b51 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.011084:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bef1bd45/0xc6b8ac1b0915a60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b4a expref: 8 pid: 8216 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.011086:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375200, rc 0) 00000100:00100000:3.0:1788843234.011231:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 77 00000100:00100000:3.0:1788843234.011244:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2358:x1875737775789184:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843234.011266:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843234.011299:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bef1bd45/0xc6b8ac1b0915a60 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b4a expref: 8 pid: 8216 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.011316:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bef1bd45/0xc6b8ac1b0915a60 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b4a expref: 8 pid: 8216 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.011385:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bef1bd45/0xc6b8ac1b0915a60 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b4a expref: 8 pid: 8216 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.011428:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843234.011433:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843234.011444:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001f0239d0/0xc6b8ac1b0915a67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b51 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.011457:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f0239d0/0xc6b8ac1b0915a67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b51 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.011501:0:5832:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001f0239d0/0xc6b8ac1b0915a67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b51 expref: 7 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843234.011520:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e77bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5832:1875737795702016:192.168.203.29@tcp:105: 00000100:00100000:2.0:1788843234.011919:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c25500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:11582:x1875737775789056:12345-192.168.203.29@tcp:101:bash.0 Request processed in 12486us (16143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843234.011930:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:3.0:1788843234.011992:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab73b8e480 going to sleep for 11 seconds 00000100:00100000:3.0:1788843234.016806:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e77bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5832:1875737795702016:192.168.203.29@tcp:105: 00010000:00010000:3.0:1788843234.016854:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843234.016990:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2358:x1875737775789184:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 5747us (6087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843234.017007:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 77 00000100:00100000:1.0:1788843234.018136:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843234.018237:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775789440 00000100:00100000:2.0:1788843234.018247:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775789440 00000100:00100000:2.0:1788843234.018316:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 55 00000100:00100000:2.0:1788843234.018328:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+38:11582:x1875737775789440:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:2.0:1788843234.018981:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+39:11582:x1875737775789440:12345-192.168.203.29@tcp:35:bash.0 Request processed in 651us (850us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788843234.018991:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 55 00010000:00010000:3.0:1788843234.055844:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843234.163943:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843234.165032:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775789568 00000100:00100000:2.0:1788843234.165050:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775789568 00000100:00100000:2.0:1788843234.165145:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 200 00000100:00100000:2.0:1788843234.165157:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+39:11598:x1875737775789568:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843234.165190:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843234.165220:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b0915a6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b58 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.165326:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915a75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.165363:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.165378:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843234.165425:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788843234.165429:0:7168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843234.165452:0:7168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915a75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.165481:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b0915a6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b58 expref: 41 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.165517:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915a75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b58 expref: 40 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.165528:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843234.165531:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843234.165536:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374c00, rc 0) 00000100:00100000:2.0:1788843234.165641:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+40:11598:x1875737775789568:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 487us (1721us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843234.165648:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 200 00000100:00100000:0.0:1788843234.170606:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843234.170776:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775789824 00000100:00100000:2.0:1788843234.170790:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775789824 00000100:00100000:2.0:1788843234.170910:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 201 00000100:00100000:2.0:1788843234.170923:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+40:11598:x1875737775789824:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843234.170954:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843234.170981:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915a7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b5f expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.171131:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0915a83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.171150:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0915a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.171165:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0915a83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843234.171178:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788843234.171383:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915a7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b5f expref: 43 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.171428:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0915a83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b5f expref: 42 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.171437:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab43e63200) 00010000:00010000:2.0:1788843234.171441:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843234.171445:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375c00, rc 0) 00000100:00100000:2.0:1788843234.171533:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+42:11598:x1875737775789824:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 612us (944us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788843234.171541:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 201 00000100:00100000:1.0:1788843234.175886:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843234.175956:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843234.176057:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775790080 00000100:00100000:0.0:1788843234.176073:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775790080 00000100:00100000:0.0:1788843234.176180:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 202 00000100:00100000:0.0:1788843234.176194:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+42:11598:x1875737775790080:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1788843234.176232:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843234.176287:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915a91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b66 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.176487:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915a98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.176509:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915a98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.176524:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915a98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843234.176540:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788843234.176756:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915a91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b66 expref: 45 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.176782:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915a98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b66 expref: 44 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.176794:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab43e63200) 00010000:00010000:0.0:1788843234.176798:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788843234.176803:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4e00, rc 0) 00000100:00100000:0.0:1788843234.176912:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+44:11598:x1875737775790080:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 720us (1568us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1788843234.176922:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 202 00000100:00100000:2.0:1788843234.182316:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775790208 00000100:00100000:2.0:1788843234.182566:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775790208 00000100:00100000:2.0:1788843234.182699:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:2.0:1788843234.182714:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+44:2358:x1875737775790208:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843234.182738:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843234.182780:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0915a83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b5f expref: 44 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.182827:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab43e63200) 00010000:00010000:2.0:1788843234.182835:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843234.182948:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+43:2358:x1875737775790208:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 238us (6991us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843234.182957:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:0.0:1788843234.186121:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843234.186219:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775790336 00000100:00100000:3.0:1788843234.186235:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775790336 00000100:00100000:3.0:1788843234.186382:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:3.0:1788843234.186395:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+6:2357:x1875737775790336:12345-192.168.203.29@tcp:1:lfs.0 00010000:00010000:3.0:1788843234.186471:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc6736ca/0xc6b8ac1b0915aa6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.186518:0:6694:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001f0239d0/0xc6b8ac1b0915a67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b51 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.186527:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843234.186531:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843234.186536:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc6736ca/0xc6b8ac1b0915aa6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.186579:0:6694:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001f0239d0/0xc6b8ac1b0915a67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b51 expref: 6 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.186597:0:6694:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001f0239d0/0xc6b8ac1b0915a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b51 expref: 6 pid: 6692 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843234.186616:0:6694:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e77bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1875737795702144:192.168.203.29@tcp:104: 00000100:00100000:3.0:1788843234.186950:0:6694:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab73b8e480 going to sleep for 11 seconds 00000100:00100000:0.0:1788843234.190499:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843234.190971:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775790464 00000100:00100000:1.0:1788843234.190983:0:6700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775790464 00002000:00100000:1.0:1788843234.191057:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8dab73a7b800 x1875737775790464/t0(0) o4->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:605/0 lens 504/0 e 0 to 0 dl 1788843245 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788843234.191070:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab73a7b800 with x1875737775790464 ext(0->8) 00010000:00010000:1.0:1788843234.191083:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001f0239d0/0xc6b8ac1b0915a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b51 expref: 7 pid: 6692 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.191105:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001f0239d0/0xc6b8ac1b0915a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b51 expref: 7 pid: 6692 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788843234.191114:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8dab73a7b800 00000100:00100000:1.0:1788843234.191154:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:1.0:1788843234.191169:0:6700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2359:x1875737775790464:12345-192.168.203.29@tcp:4:lfs.0 00000100:00100000:1.0:1788843234.191999:0:6700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+9:2359:x1875737775790464:12345-192.168.203.29@tcp:4:lfs.0 Request processed in 827us (1495us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788843234.192010:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00002000:00100000:1.0:1788843234.192020:0:6700:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8dab73a7b800 x1875737775790464/t4294967308(0) o4->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:605/0 lens 504/448 e 0 to 0 dl 1788843245 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788843234.192030:0:6700:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab73a7b800 with x1875737775790464 ext(0->8) 00010000:00010000:1.0:1788843234.192039:0:6700:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000001f0239d0/0xc6b8ac1b0915a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b51 expref: 9 pid: 6692 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.192057:0:6700:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000001f0239d0/0xc6b8ac1b0915a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b51 expref: 9 pid: 6692 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788843234.192076:0:6700:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8dab73a7b800 00000100:00100000:3.0:1788843234.192736:0:6694:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e77bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6694:1875737795702144:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843234.192779:0:6694:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bc6736ca/0xc6b8ac1b0915aa6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843234.198997:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843234.199462:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775790592 00000100:00100000:3.0:1788843234.199478:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775790592 00010000:00010000:3.0:1788843234.199537:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001f0239d0/0xc6b8ac1b0915a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b51 expref: 9 pid: 6692 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843234.199619:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 78 00000100:00100000:3.0:1788843234.199632:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+9:2359:x1875737775790592:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843234.199655:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788843234.199684:0:7638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788843234.199688:0:7638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788843234 00002000:00010000:3.0:1788843234.199691:0:7638:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788843234 00002000:00010000:3.0:1788843234.199693:0:7638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788843234 00010000:00010000:3.0:1788843234.199700:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001f0239d0/0xc6b8ac1b0915a67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b51 expref: 9 pid: 6692 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.199717:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001f0239d0/0xc6b8ac1b0915a67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b51 expref: 9 pid: 6692 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.199746:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f0239d0/0xc6b8ac1b0915a67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b51 expref: 9 pid: 6692 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.199770:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843234.199775:0:7638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843234.199784:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc6736ca/0xc6b8ac1b0915aa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.199796:0:7638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc6736ca/0xc6b8ac1b0915aa6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.199848:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843234.199945:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e848000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2359:x1875737775790592:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 315us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843234.199954:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 78 00010000:00010000:1.0:1788843234.200730:0:6694:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bc6736ca/0xc6b8ac1b0915aa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.200746:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc6736ca/0xc6b8ac1b0915aa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.200786:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc6736ca/0xc6b8ac1b0915aa6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.200795:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc6736ca/0xc6b8ac1b0915aa6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.200805:0:6694:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc6736ca/0xc6b8ac1b0915aa6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.200813:0:6694:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799f600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843234.200819:0:6694:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc6736ca/0xc6b8ac1b0915aa6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.200830:0:6694:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc6736ca/0xc6b8ac1b0915aa6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.200851:0:6694:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc6736ca/0xc6b8ac1b0915aa6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.200889:0:6694:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc6736ca/0xc6b8ac1b0915aa6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843234.200989:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2357:x1875737775790336:12345-192.168.203.29@tcp:1:lfs.0 Request processed in 14594us (14881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843234.200999:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:0.0:1788843234.207799:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843234.207965:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775790848 00000100:00100000:3.0:1788843234.207980:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775790848 00000100:00100000:3.0:1788843234.208057:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 56 00000100:00100000:3.0:1788843234.208070:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6640e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+43:11598:x1875737775790848:12345-192.168.203.29@tcp:35:lfs.0 00000004:00010000:3.0:1788843234.208171:0:5849:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915a98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b66 expref: 43 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788843234.208780:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788843234.208833:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1788843234.213836:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:2.0:1788843234.214008:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915aad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.214048:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915a52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b43 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.214061:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915aad lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.214132:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915a52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b43 expref: 47 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.214161:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915a52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b43 expref: 47 pid: 5846 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843234.214186:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c143100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1875737795702272:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843234.215875:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa1e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843234.222223:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843234.222386:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775790976 00000100:00100000:3.0:1788843234.222403:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775790976 00010000:00010000:3.0:1788843234.222479:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915a52 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b43 expref: 48 pid: 5846 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843234.222533:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 79 00000100:00100000:3.0:1788843234.222545:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+48:2359:x1875737775790976:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843234.222569:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843234.222579:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915a52 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b43 expref: 48 pid: 5846 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.222596:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915a52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b43 expref: 48 pid: 5846 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.222631:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab43e63200) 00010000:00010000:3.0:1788843234.222639:0:5832:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915aad lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.222672:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915aad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.222682:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915aad lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.222705:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843234.222798:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+48:2359:x1875737775790976:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 254us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843234.222807:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 79 00010000:00010000:2.0:1788843234.223299:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e200/0xc6b8ac1b0915a52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b43 expref: 47 pid: 5846 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843234.223321:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c143100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5849:1875737795702272:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843234.223406:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915aad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.223416:0:5849:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915aad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.223421:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915aad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788843234.223602:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1788843234.223892:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788843234.224046:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c143100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1875737795702400:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788843234.224882:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843234.225149:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa1e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788843234.225293:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795702400 00000100:00100000:1.0:1788843234.225305:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795702400 00000100:00080000:0.0:1788843234.225415:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843234.225514:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788843234.225526:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1875737795702400:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788843234.225653:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1875737795702400:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 128us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843234.225661:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788843234.225802:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c143100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1875737795702400:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788843234.226461:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1788843234.226555:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e77bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1875737795702528:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788843234.226614:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843234.226648:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab73b8e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788843234.226838:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795702528 00000100:00100000:1.0:1788843234.226846:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795702528 00000100:00100000:1.0:1788843234.226901:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788843234.226909:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5849:x1875737795702528:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788843234.227123:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e779f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5849:x1875737795702528:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 213us (509us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788843234.227131:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788843234.227253:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e77bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5849:1875737795702528:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788843234.227323:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1788843234.227606:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915aad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.227619:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915aad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.227629:0:5849:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915aad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.227636:0:5849:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843234.227641:0:5849:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915aad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.227668:0:5849:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915aad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.227691:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab43e63200) 00010000:00010000:3.0:1788843234.227695:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788843234.227702:0:5849:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915aad lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.227709:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915aad lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788843234.227986:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788843234.228105:0:5849:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1788843234.228119:0:5849:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358478776546ns, next at 359478774197ns, rc = 0 00000001:00080000:3.0:1788843234.228128:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1788843234.228165:0:5849:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab43e63200) 00010000:00010000:3.0:1788843234.228169:0:5849:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788843234.228178:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915a98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b66 expref: 51 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843234.228753:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6640e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+50:11598:x1875737775790848:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 20684us (20968us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788843234.228764:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 56 00000020:00080000:3.0:1788843234.228770:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788843234.233087:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843234.233174:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775791104 00000100:00100000:2.0:1788843234.233188:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775791104 00000100:00100000:2.0:1788843234.233273:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 203 00000100:00100000:2.0:1788843234.233286:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+50:11598:x1875737775791104:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843234.233322:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843234.233408:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374400/0xc6b8ac1b0915ab4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b6d expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.233488:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374400/0xc6b8ac1b0915ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b6d expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.233520:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374400/0xc6b8ac1b0915ab4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b6d expref: 51 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.233550:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:2.0:1788843234.233554:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788843234.233559:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374400, rc 0) 00000100:00100000:2.0:1788843234.233786:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+51:11598:x1875737775791104:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 501us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843234.233794:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 203 00000100:00100000:2.0:1788843234.239701:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843234.239984:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775791360 00000100:00100000:3.0:1788843234.240001:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775791360 00000100:00100000:3.0:1788843234.240081:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:3.0:1788843234.240094:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+51:11598:x1875737775791360:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:3.0:1788843234.240546:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+52:11598:x1875737775791360:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 453us (860us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788843234.240556:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 57 00000100:00100000:1.0:1788843234.351842:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843234.352508:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775791488 00000100:00100000:0.0:1788843234.352526:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775791488 00000100:00100000:0.0:1788843234.353169:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 204 00000100:00100000:0.0:1788843234.353196:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+52:11608:x1875737775791488:12345-192.168.203.29@tcp:34:lfs.0 00010000:00010000:0.0:1788843234.353364:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915abb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.353390:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915abb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.353430:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915abb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.353450:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915ac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.353457:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.353464:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.354370:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915ac9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.354387:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.354397:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788843234.354462:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.354479:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915abb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.354487:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915abb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.354494:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915abb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.354516:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843234.354521:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915abb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.354529:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915abb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.354545:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:0.0:1788843234.354549:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843234.354556:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915abb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.354563:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915abb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.357490:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.357517:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915ac2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.357527:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.357534:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843234.357540:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.357551:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915ac2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.357614:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab43ece200) 00010000:00010000:0.0:1788843234.357618:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843234.357625:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915ac2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.357632:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4a00/0xc6b8ac1b0915ac2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.357666:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915ac9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.357675:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915ac9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.357681:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.357686:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843234.357690:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915ac9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.357697:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915ac9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.357706:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:0.0:1788843234.357709:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843234.357713:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915ac9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.357719:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5800/0xc6b8ac1b0915ac9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843234.357917:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+52:11608:x1875737775791488:12345-192.168.203.29@tcp:34:lfs.0 Request processed in 4727us (6080us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843234.357930:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 204 00000100:00100000:2.0:1788843234.416771:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843234.417042:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775791744 00000100:00100000:1.0:1788843234.417127:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775791744 00000100:00100000:1.0:1788843234.417481:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 205 00000100:00100000:1.0:1788843234.417492:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+52:11611:x1875737775791744:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1788843234.417547:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843234.417576:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915ad0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b74 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.417676:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915ad7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.417696:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.417710:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.417727:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915ade lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.417734:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.417742:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.418187:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915ae5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.418199:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.418207:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843234.418219:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788843234.418638:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915ad7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.418648:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915ad7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.418656:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915ad7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.418663:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933a000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843234.418668:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915ad7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.418678:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915ad7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.418694:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:1.0:1788843234.418697:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843234.418704:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915ad7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.418711:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915ad7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.418731:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915ade lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.418738:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915ade lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.418745:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.418750:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933bc00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843234.418764:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915ade lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.418771:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915ade lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.418780:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab61f39500) 00010000:00010000:1.0:1788843234.418782:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843234.418785:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915ade lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.418792:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915ade lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.418980:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915ad0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b74 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.419001:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b74 expref: 54 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.419009:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:1.0:1788843234.419013:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843234.419016:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b400, rc 0) 00000100:00100000:1.0:1788843234.419753:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+54:11611:x1875737775791744:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 2257us (2992us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788843234.419765:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 205 00000100:00100000:2.0:1788843234.423814:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843234.424536:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775791872 00000100:00100000:3.0:1788843234.424551:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775791872 00000100:00100000:3.0:1788843234.424641:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 206 00000100:00100000:3.0:1788843234.424654:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+54:11611:x1875737775791872:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:3.0:1788843234.424767:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915af3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.424791:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915af3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.424808:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915af3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.424971:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915af3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.424981:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915af3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.424988:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915af3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.424995:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799ea00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843234.425000:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915af3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.425008:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915af3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.425045:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:3.0:1788843234.425119:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843234.425127:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915af3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.425135:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915af3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843234.425740:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+54:11611:x1875737775791872:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 1083us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843234.425753:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 206 00000100:00100000:2.0:1788843234.433982:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843234.434652:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775792128 00000100:00100000:3.0:1788843234.434666:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775792128 00000100:00100000:3.0:1788843234.434787:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00100000:3.0:1788843234.434801:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+54:11611:x1875737775792128:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:3.0:1788843234.435172:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+55:11611:x1875737775792128:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 374us (1207us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788843234.435188:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 58 00000100:00100000:2.0:1788843234.545682:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843234.545903:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775792384 00000100:00100000:3.0:1788843234.545921:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775792384 00000100:00100000:3.0:1788843234.546046:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 207 00000100:00100000:3.0:1788843234.546061:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+55:11621:x1875737775792384:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:3.0:1788843234.546107:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843234.546112:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788843234.546163:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915a75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b58 expref: 55 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.546265:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:3.0:1788843234.546284:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843234.546793:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915afa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b7b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.547060:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915b01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.547082:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.547097:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843234.547112:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788843234.547941:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915afa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b7b expref: 57 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.548716:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915b01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b7b expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.548731:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:3.0:1788843234.548735:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843234.548739:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799e000, rc 0) 00000100:00100000:3.0:1788843234.548847:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+56:11621:x1875737775792384:12345-192.168.203.29@tcp:101:bash.0 Request processed in 2788us (3181us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788843234.548857:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 207 00000100:00100000:0.0:1788843234.556859:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843234.557185:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775792640 00000100:00100000:1.0:1788843234.557199:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775792640 00000100:00100000:1.0:1788843234.557292:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 208 00000100:00100000:1.0:1788843234.557313:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+56:11621:x1875737775792640:12345-192.168.203.29@tcp:36:bash.0 00010000:00010000:1.0:1788843234.557445:0:5848:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788843234.557716:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e000/0xc6b8ac1b0915b01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b7b expref: 56 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.557746:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915ae5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b74 expref: 55 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.557762:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:1.0:1788843234.557769:0:5848:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843234.559827:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915b0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.559877:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915b0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.559893:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915b0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788843234.560877:0:5848:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:1.0:1788843234.562064:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4212852 reply state 000000006f8163ae transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915b0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843234.562086:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788843234.563136:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+57:11621:x1875737775792640:12345-192.168.203.29@tcp:36:bash.0 Request processed in 5818us (6648us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1788843234.563150:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 208 00000020:00080000:1.0:1788843234.563160:0:5848:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788843234.571294:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915b0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.571798:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915b0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.571806:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915b0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.571812:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843234.571818:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915b0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.571828:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915b0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.572225:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:3.0:1788843234.572230:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843234.572237:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915b0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.572245:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915b0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843234.572603:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843234.572774:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775792768 00000100:00100000:1.0:1788843234.572788:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775792768 00000100:00100000:1.0:1788843234.572887:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 209 00000100:00100000:1.0:1788843234.572913:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+56:11621:x1875737775792768:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:1.0:1788843234.572945:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843234.572978:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915b16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b82 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.573091:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915b1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.573107:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.573119:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843234.573154:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788843234.573159:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788843234.573182:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915b1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.573211:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915b16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b82 expref: 58 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.573230:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b82 expref: 57 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.573239:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:1.0:1788843234.573242:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843234.573246:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933bc00, rc 0) 00000100:00100000:1.0:1788843234.573331:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+57:11621:x1875737775792768:12345-192.168.203.29@tcp:101:bash.0 Request processed in 421us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843234.573389:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 209 00000100:00100000:2.0:1788843234.577873:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843234.578103:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775793024 00000100:00100000:3.0:1788843234.578117:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775793024 00000100:00100000:3.0:1788843234.578195:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:3.0:1788843234.578207:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+57:11621:x1875737775793024:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:3.0:1788843234.578804:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+58:11621:x1875737775793024:12345-192.168.203.29@tcp:35:bash.0 Request processed in 596us (964us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1788843234.578814:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 59 00000100:00100000:2.0:1788843234.674185:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843234.676192:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775793152 00000100:00100000:3.0:1788843234.676234:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775793152 00000100:00100000:2.0:1788843234.678796:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 210 00000100:00100000:2.0:1788843234.678819:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+58:11627:x1875737775793152:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843234.679240:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843234.679287:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b0915b24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b89 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.679748:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915b2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.679770:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915b2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.679808:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915b2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843234.680059:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788843234.680065:0:7168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843234.680096:0:7168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915b2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.680150:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374a00/0xc6b8ac1b0915b24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b89 expref: 60 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.680202:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915b2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b89 expref: 59 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.680213:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843234.680216:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843234.680221:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374c00, rc 0) 00000100:00100000:2.0:1788843234.681915:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+59:11627:x1875737775793152:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 3091us (7732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843234.681929:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 210 00000100:00100000:0.0:1788843234.686542:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843234.686751:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775793280 00000100:00100000:2.0:1788843234.686766:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775793280 00000100:00100000:2.0:1788843234.686869:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 211 00000100:00100000:2.0:1788843234.686883:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+59:11627:x1875737775793280:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843234.686913:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843234.686946:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0915b32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b90 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687061:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915b39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687081:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915b39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687094:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915b39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687111:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915b40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687119:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687126:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687253:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915b47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687262:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687270:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843234.687318:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788843234.687323:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843234.687372:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687400:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915b47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687410:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915b39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687418:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915b39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687436:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915b39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687443:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374600 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843234.687447:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915b39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687456:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915b39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687472:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843234.687476:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843234.687482:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915b39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687490:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374600/0xc6b8ac1b0915b39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687525:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915b40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687532:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915b40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687551:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915b40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687556:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843234.687559:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915b40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.687566:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915b40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.691125:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab54910400) 00010000:00010000:2.0:1788843234.691143:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843234.691165:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915b40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.691179:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374000/0xc6b8ac1b0915b40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.691956:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0915b32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b90 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.691992:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b90 expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.692004:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:2.0:1788843234.692007:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843234.692010:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374200, rc 0) 00000100:00100000:2.0:1788843234.692179:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+60:11627:x1875737775793280:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 5296us (5652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843234.692226:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 211 00000100:00100000:3.0:1788843234.707023:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843234.707106:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843234.708061:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775793664 00000100:00100000:0.0:1788843234.708078:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775793664 00000100:00100000:0.0:1788843234.708182:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 212 00000100:00100000:0.0:1788843234.708196:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+60:11627:x1875737775793664:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1788843234.708234:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843234.708269:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915b4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b97 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.708792:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.708816:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915b1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b82 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.708825:0:5848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915b47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b90 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.708836:0:5848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.709111:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915b47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b90 expref: 61 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.709157:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915b47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b90 expref: 61 pid: 5847 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843234.709178:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1875737795702656:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843234.709605:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775793408 00000100:00100000:2.0:1788843234.709614:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775793408 00010000:00010000:2.0:1788843234.709655:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915b47 lrc: 6/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b90 expref: 62 pid: 5847 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843234.709697:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 80 00000100:00100000:2.0:1788843234.709707:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e778700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+62:2359:x1875737775793408:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843234.709724:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843234.709731:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915b47 lrc: 6/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b90 expref: 62 pid: 5847 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.709746:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915b47 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b90 expref: 62 pid: 5847 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.709771:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:2.0:1788843234.709775:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.709781:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.709784:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788843234.712071:0:5848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b82 expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.712105:0:5848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915b1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b82 expref: 62 pid: 5847 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843234.712128:0:5848:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1875737795702784:192.168.203.29@tcp:104: 00000100:00100000:0.0:1788843234.712198:0:5848:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4936a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843234.716686:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e778700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+62:2359:x1875737775793408:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 6951us (9656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843234.716709:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 80 00010000:00010000:1.0:1788843234.717721:0:5848:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.29@tcp) returned -22 from blocking AST (req@0000000026130897 x1875737795702656) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915b47 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b90 expref: 61 pid: 5847 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.717749:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915b47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b90 expref: 61 pid: 5847 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843234.717784:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1875737795702656:192.168.203.29@tcp:104: 00000100:00100000:0.0:1788843234.718130:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843234.719149:0:5848:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5848:1875737795702784:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843234.719187:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:1.0:1788843234.719195:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.719207:0:5848:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843234.719219:0:5848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843234.719651:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775793792 00000100:00100000:3.0:1788843234.719663:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775793792 00010000:00010000:3.0:1788843234.719719:0:5833:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915b1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b82 expref: 61 pid: 5847 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843234.719766:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00100000:3.0:1788843234.719776:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+61:2358:x1875737775793792:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843234.719795:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843234.719803:0:5833:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915b1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b82 expref: 61 pid: 5847 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.719817:0:5833:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915b1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b82 expref: 61 pid: 5847 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.720030:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915b1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b82 expref: 61 pid: 5847 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.720050:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:3.0:1788843234.720055:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.720065:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.720093:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.720186:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843234.720266:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+60:2358:x1875737775793792:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 490us (2137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843234.720274:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 81 00010000:00010000:2.0:1788843234.723978:0:5848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843234.724004:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843234.724071:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788843234.726954:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915b4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b97 expref: 61 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.726994:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b97 expref: 60 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.727007:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:0.0:1788843234.727010:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788843234.727015:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab821c4000, rc 0) 00000100:00100000:0.0:1788843234.727180:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e77b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+60:11627:x1875737775793664:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 18984us (20071us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1788843234.727191:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 212 00000100:00100000:2.0:1788843234.734115:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843234.734249:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775794048 00000100:00100000:0.0:1788843234.734268:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775794048 00000100:00100000:0.0:1788843234.734856:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:0.0:1788843234.734879:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4886e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+60:11627:x1875737775794048:12345-192.168.203.29@tcp:103:lfs.0 00010000:00010000:0.0:1788843234.734905:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843234.734947:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374400/0xc6b8ac1b0915ab4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b6d expref: 60 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843234.734990:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:0.0:1788843234.734997:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843234.735087:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4886e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+59:11627:x1875737775794048:12345-192.168.203.29@tcp:103:lfs.0 Request processed in 212us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843234.735095:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:0.0:1788843234.742061:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843234.742767:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775794176 00000100:00100000:3.0:1788843234.742781:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775794176 00000100:00100000:3.0:1788843234.742888:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 213 00000100:00100000:3.0:1788843234.742901:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+59:11627:x1875737775794176:12345-192.168.203.29@tcp:58:lfs.0 00010000:00010000:3.0:1788843234.743045:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915b63 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.743065:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915b63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.743078:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915b63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788843234.743830:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788843234.744136:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+59:11627:x1875737775794176:12345-192.168.203.29@tcp:58:lfs.0 Request processed in 1233us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843234.744149:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 213 00000100:00100000:2.0:1788843234.749794:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843234.750074:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775794304 00000100:00100000:3.0:1788843234.750089:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775794304 00000100:00100000:3.0:1788843234.750180:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 214 00000100:00100000:3.0:1788843234.750196:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+59:11627:x1875737775794304:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843234.750240:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843234.750273:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b0915b6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084b9e expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.750748:0:7168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915b63 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.750765:0:7168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b0915b6a lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b9e expref: 60 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.750791:0:7168:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915b63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.750807:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b0915b6a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b9e expref: 60 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.750824:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:3.0:1788843234.750827:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843234.750831:0:7168:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b0915b6a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b9e expref: 60 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843234.750840:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799f800, rc 0) 00000100:00100000:3.0:1788843234.751022:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+60:11627:x1875737775794304:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 830us (1246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843234.751031:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 214 00010000:00010000:2.0:1788843235.076917:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788843235.335582:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788843235.335597:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788843235.335645:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1788843235.335660:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788843235.335848:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e778700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875737795702912:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788843235.336019:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab73b8e600 going to sleep for 11 seconds 00000100:00100000:2.0:1788843235.351109:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843235.352948:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e778700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875737795702912:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788843235.353754:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775794432 00000100:00100000:1.0:1788843235.353769:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775794432 00000100:00100000:1.0:1788843235.353967:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 215 00000100:00100000:1.0:1788843235.353980:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+60:11629:x1875737775794432:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788843235.354051:0:5847:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788843235.354236:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+60:11629:x1875737775794432:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 258us (3151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843235.354257:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 215 00000100:00080000:0.0:1788843235.354471:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843235.361110:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843235.361264:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775794560 00000100:00100000:0.0:1788843235.361632:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775794560 00000100:00100000:0.0:1788843235.361769:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 216 00000100:00100000:0.0:1788843235.361787:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+60:11629:x1875737775794560:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788843235.361926:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915b71 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.361962:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915b71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.361980:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915b71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.362004:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915b78 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.362035:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915b78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.362043:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915b78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.362079:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915b7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.362088:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.362095:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843235.362155:0:5848:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788843235.362162:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788843235.362182:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.362199:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915b71 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.362208:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915b71 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.362218:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915b71 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.362225:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843235.362232:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915b71 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.362251:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915b71 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.363665:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab61f39d00) 00010000:00010000:0.0:1788843235.363677:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843235.363690:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915b71 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.363701:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4e00/0xc6b8ac1b0915b71 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.363731:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915b78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.363739:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915b78 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.363746:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915b78 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.363752:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5e00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843235.363756:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915b78 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.363764:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915b78 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.363777:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8dab43ece200) 00010000:00010000:0.0:1788843235.363780:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843235.363782:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915b78 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.363808:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5e00/0xc6b8ac1b0915b78 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.363830:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915b7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.363836:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915b7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.363842:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915b7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.363847:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843235.363851:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915b7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.363867:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915b7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.363876:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:0.0:1788843235.363878:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843235.363881:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915b7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.363887:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915b7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843235.364537:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+60:11629:x1875737775794560:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 Request processed in 2745us (3440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843235.364550:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 216 00000100:00100000:2.0:1788843235.373757:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843235.377566:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775794816 00000100:00100000:3.0:1788843235.377590:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775794816 00000100:00100000:3.0:1788843235.377696:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 217 00000100:00100000:3.0:1788843235.377710:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+60:11629:x1875737775794816:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843235.377744:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843235.377776:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ee00/0xc6b8ac1b0915b86 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ba5 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.377942:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b0915b8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.381739:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b0915b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.381762:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b0915b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843235.381800:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788843235.384109:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b0915b8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.384140:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b0915b8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.384151:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b0915b8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.384159:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799fc00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843235.384166:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b0915b8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.384177:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b0915b8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.384205:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:1.0:1788843235.384208:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788843235.384217:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b0915b8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.384224:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fc00/0xc6b8ac1b0915b8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.384681:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ee00/0xc6b8ac1b0915b86 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ba5 expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.384700:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab61f39d00) 00010000:00010000:1.0:1788843235.384731:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788843235.384738:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ee00/0xc6b8ac1b0915b86 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ba5 expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.384752:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799ee00, rc 0) 00000100:00100000:1.0:1788843235.384894:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+61:11629:x1875737775794816:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 7184us (11152us total) trans 4294967504 rc 301/301 00000100:00100000:1.0:1788843235.384907:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 217 00000100:00100000:2.0:1788843235.400917:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843235.401066:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775794944 00000100:00100000:3.0:1788843235.401078:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775794944 00000100:00100000:3.0:1788843235.401163:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 218 00000100:00100000:3.0:1788843235.401175:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+61:11629:x1875737775794944:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788843235.401222:0:7168:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788843235.401614:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+61:11629:x1875737775794944:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 439us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843235.401643:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 218 00000100:00100000:2.0:1788843235.410580:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843235.410689:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775795200 00000100:00100000:1.0:1788843235.410708:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775795200 00000100:00100000:1.0:1788843235.410805:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 219 00000100:00100000:1.0:1788843235.410817:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+61:11629:x1875737775795200:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788843235.410847:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843235.410852:0:5846:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788843235.410906:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915b2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b89 expref: 61 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.410964:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:1.0:1788843235.410972:0:5846:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843235.410994:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915b9b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084bac expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788843235.411719:0:5846:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1788843235.412059:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915ba2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.412079:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.412123:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.412214:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915b9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bac expref: 63 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.412239:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bac expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.412249:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:1.0:1788843235.412252:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843235.412255:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933a000, rc 0) 00000100:00100000:1.0:1788843235.412381:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+62:11629:x1875737775795200:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 1566us (1817us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788843235.412389:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 219 00000100:00100000:2.0:1788843235.427128:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843235.427296:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775795456 00000100:00100000:3.0:1788843235.427311:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775795456 00000100:00100000:3.0:1788843235.427421:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 220 00000100:00100000:3.0:1788843235.427436:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+62:11629:x1875737775795456:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788843235.427527:0:7168:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843235.427564:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915ba2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bac expref: 62 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.427592:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:3.0:1788843235.427605:0:7168:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843235.427645:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915bb0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.427664:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915bb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.427678:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915bb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.427965:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f000/0xc6b8ac1b0915bb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x156ad298 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.427996:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f000/0xc6b8ac1b0915bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x156ad298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.428013:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f000/0xc6b8ac1b0915bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x156ad298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.428195:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915bb0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.428220:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915bb0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.428229:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915bb0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.428236:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799e800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843235.428241:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915bb0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.428251:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915bb0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.428266:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:3.0:1788843235.428270:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843235.428276:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915bb0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.428282:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b0915bb0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.428301:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f000/0xc6b8ac1b0915bb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x156ad298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.428306:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f000/0xc6b8ac1b0915bb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x156ad298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.428312:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f000/0xc6b8ac1b0915bb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x156ad298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.428317:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799f000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843235.428325:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f000/0xc6b8ac1b0915bb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x156ad298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.428331:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f000/0xc6b8ac1b0915bb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x156ad298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.428339:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x156ad298 (ffff8dab43e63200) 00010000:00010000:3.0:1788843235.428393:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843235.428397:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f000/0xc6b8ac1b0915bb7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x156ad298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.428404:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f000/0xc6b8ac1b0915bb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x156ad298 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843235.428626:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+61:11629:x1875737775795456:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 1189us (1506us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788843235.428636:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 220 00000100:00100000:2.0:1788843235.435939:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843235.436043:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775795584 00000100:00100000:3.0:1788843235.436055:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775795584 00000100:00100000:3.0:1788843235.436133:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 221 00000100:00100000:3.0:1788843235.436145:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+61:11629:x1875737775795584:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843235.436167:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843235.436190:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b0915bbe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084bb3 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.436226:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b0915bc5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.436238:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b0915bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.436266:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b0915bc5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.436504:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fa00/0xc6b8ac1b0915bbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bb3 expref: 63 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.436524:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b0915bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bb3 expref: 62 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.436533:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dab43e63500) 00010000:00010000:3.0:1788843235.436537:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788843235.436540:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799e600, rc 0) 00000100:00100000:3.0:1788843235.436602:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+62:11629:x1875737775795584:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 460us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843235.436610:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 221 00000100:00100000:3.0:1788843235.439472:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843235.440664:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775795840 00000100:00100000:0.0:1788843235.440680:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775795840 00000100:00100000:0.0:1788843235.440880:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 222 00000100:00100000:0.0:1788843235.440894:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+62:11629:x1875737775795840:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788843235.441050:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915bcc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.441084:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915bcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.441098:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915bcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843235.441621:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1788843235.441636:0:5848:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359692293339ns, next at 360692289274ns, rc = 0 00000004:00010000:0.0:1788843235.441897:0:5848:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f645b10a reply state 00000000423a3855 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915bcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843235.441909:0:5848:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788843235.442057:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e778700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+64:11629:x1875737775795840:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 1162us (2595us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788843235.442067:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 222 00010000:00010000:3.0:1788843235.457460:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915bcc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.457482:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915bcc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.457491:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915bcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.457508:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843235.457514:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915bcc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.457543:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915bcc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.457561:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dab43e63500) 00010000:00010000:3.0:1788843235.457565:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788843235.457570:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915bcc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.457578:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915bcc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843235.469020:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843235.469751:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775795968 00000100:00100000:1.0:1788843235.469765:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775795968 00000100:00100000:1.0:1788843235.469847:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 223 00000100:00100000:1.0:1788843235.469870:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+63:11629:x1875737775795968:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788843235.469912:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843235.469949:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915bd3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084bba expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.470053:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915bd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bba expref: 64 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.470073:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915bd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bba expref: 64 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.470127:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dab43e63500) 00010000:00010000:1.0:1788843235.470131:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788843235.470137:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933bc00, rc 0) 00000100:00100000:1.0:1788843235.470239:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+64:11629:x1875737775795968:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 380us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843235.470248:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 223 00000100:00100000:2.0:1788843235.475469:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843235.475529:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843235.475630:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775796096 00000100:00100000:0.0:1788843235.475643:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775796096 00000100:00100000:0.0:1788843235.475697:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 292 00000100:00100000:0.0:1788843235.475724:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2356:x1875737775796096:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843235.475796:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2356:x1875737775796096:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 90us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843235.475803:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 292 00000100:00100000:2.0:1788843235.476759:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843235.480548:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843235.480631:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775796480 00000100:00100000:2.0:1788843235.480642:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775796480 00000100:00080000:0.0:1788843235.480721:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843235.481001:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 154 00000100:00100000:2.0:1788843235.481020:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2356:x1875737775796480:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843235.481121:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2356:x1875737775796480:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 109us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843235.481128:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 154 00000100:00100000:3.0:1788843235.481303:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775796352 00000100:00100000:3.0:1788843235.481308:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775796352 00000100:00100000:1.0:1788843235.481482:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775796224 00000100:00100000:1.0:1788843235.481487:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775796224 00000100:00080000:2.0:1788843235.481572:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788843235.481575:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843235.481964:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 91 00000100:00100000:3.0:1788843235.481974:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2356:x1875737775796352:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843235.482044:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2356:x1875737775796352:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 73us (6514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843235.482051:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 91 00000100:00100000:2.0:1788843235.482130:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 92 00000100:00100000:2.0:1788843235.482144:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+9:2356:x1875737775796224:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843235.482183:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+9:2356:x1875737775796224:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 45us (5431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843235.482215:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 92 00000100:00100000:2.0:1788843235.493265:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843235.493405:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775796608 00000100:00100000:1.0:1788843235.493419:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775796608 00000100:00100000:1.0:1788843235.493618:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:1.0:1788843235.493631:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+9:2358:x1875737775796608:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788843235.493995:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+10:2358:x1875737775796608:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 367us (744us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788843235.494003:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:0.0:1788843235.517081:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843235.517397:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775796864 00000100:00100000:3.0:1788843235.517413:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775796864 00000100:00100000:3.0:1788843235.518198:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:3.0:1788843235.518217:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+64:11629:x1875737775796864:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788843235.520874:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+65:11629:x1875737775796864:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 2634us (3787us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788843235.520894:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 60 00000100:00100000:0.0:1788843235.534218:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843235.535048:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775797120 00000100:00100000:1.0:1788843235.535068:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775797120 00000100:00100000:1.0:1788843235.535222:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 224 00000100:00100000:1.0:1788843235.535236:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+65:11629:x1875737775797120:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788843235.535461:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+65:11629:x1875737775797120:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 228us (1263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843235.535469:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 224 00000100:00100000:0.0:1788843235.542974:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843235.543189:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775797248 00000100:00100000:1.0:1788843235.543204:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775797248 00000100:00100000:1.0:1788843235.543473:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 225 00000100:00100000:1.0:1788843235.543515:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+65:11629:x1875737775797248:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788843235.543548:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843235.543587:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915bda lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084bc1 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.543701:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915be1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.543721:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.543736:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843235.543795:0:5848:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788843235.543826:0:5848:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915be1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.543871:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b400/0xc6b8ac1b0915bda lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bc1 expref: 67 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.543895:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915be1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bc1 expref: 66 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.543905:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dab43e63500) 00010000:00010000:1.0:1788843235.543908:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788843235.543913:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b800, rc 0) 00000100:00100000:1.0:1788843235.547721:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+66:11629:x1875737775797248:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 482us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843235.547794:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 225 00000100:00100000:0.0:1788843235.550897:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843235.551032:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775797376 00000100:00100000:3.0:1788843235.551065:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775797376 00000100:00100000:3.0:1788843235.551151:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:3.0:1788843235.551165:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+10:2358:x1875737775797376:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843235.551193:0:12070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843235.551227:0:12070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000c5b04de/0xc6b8ac1b0915be8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084bc8 expref: -99 pid: 12070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788843235.551271:0:12070:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f94e3, blocks: 0x1 00010000:00010000:3.0:1788843235.551304:0:12070:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1788843235.551309:0:12070:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843235.551324:0:12070:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000c5b04de/0xc6b8ac1b0915be8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bc8 expref: 11 pid: 12070 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.551418:0:12070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000c5b04de/0xc6b8ac1b0915be8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bc8 expref: 11 pid: 12070 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.551436:0:12070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799fa00, rc 0) 00000100:00100000:3.0:1788843235.551549:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+11:2358:x1875737775797376:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 386us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843235.551557:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:0.0:1788843235.567874:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843235.572987:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775797632 00000100:00100000:3.0:1788843235.573016:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775797632 00000100:00100000:3.0:1788843235.573143:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 226 00000100:00100000:3.0:1788843235.573160:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+66:11629:x1875737775797632:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788843235.573487:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+66:11629:x1875737775797632:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 187us (5498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843235.573522:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 226 00000100:00100000:0.0:1788843235.583501:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843235.583784:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775797760 00000100:00100000:1.0:1788843235.583800:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775797760 00000100:00100000:1.0:1788843235.583893:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:1.0:1788843235.583907:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+11:11629:x1875737775797760:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788843235.583938:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843235.583970:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915bef lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084bcf expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.584022:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000c5b04de/0xc6b8ac1b0915be8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bc8 expref: 12 pid: 12070 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.584035:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843235.584041:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843235.584047:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915bef lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bcf expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.584100:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000c5b04de/0xc6b8ac1b0915be8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bc8 expref: 12 pid: 12070 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.584117:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000c5b04de/0xc6b8ac1b0915be8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bc8 expref: 12 pid: 12070 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843235.584136:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6693:1875737795703040:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843235.586095:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7793a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843235.593388:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aef800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6693:1875737795703040:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843235.593454:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915bef lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bcf expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.593480:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b400, rc 0) 00000100:00100000:1.0:1788843235.593548:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+12:11629:x1875737775797760:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 9643us (10064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843235.593559:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:0.0:1788843235.595990:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843235.601063:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775797888 00000100:00100000:3.0:1788843235.601088:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775797888 00010000:00010000:2.0:1788843235.605018:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000c5b04de/0xc6b8ac1b0915be8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bc8 expref: 12 pid: 12070 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843235.605164:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 82 00000100:00100000:2.0:1788843235.605179:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+12:2358:x1875737775797888:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843235.605199:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843235.605230:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000c5b04de/0xc6b8ac1b0915be8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bc8 expref: 12 pid: 12070 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.605247:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000c5b04de/0xc6b8ac1b0915be8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bc8 expref: 12 pid: 12070 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.605277:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000c5b04de/0xc6b8ac1b0915be8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bc8 expref: 12 pid: 12070 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.605301:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843235.605306:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843235.605317:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915bef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bcf expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.605331:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915bef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bcf expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.605454:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915bef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bcf expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843235.605471:0:5831:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1875737795703168:192.168.203.29@tcp:105: 00000100:00100000:2.0:1788843235.605595:0:5831:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa1e180 going to sleep for 11 seconds 00000100:00100000:0.0:1788843235.619271:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843235.621436:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775798016 00000100:00100000:1.0:1788843235.621457:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775798016 00002000:00100000:1.0:1788843235.621538:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8dab73ffa300 x1875737775798016/t0(0) o4->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:606/0 lens 504/0 e 0 to 0 dl 1788843246 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788843235.621551:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab73ffa300 with x1875737775798016 ext(0->12) 00002000:00010000:1.0:1788843235.621559:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dab73ffa300 00000100:00100000:1.0:1788843235.621607:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:1.0:1788843235.621628:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+12:2359:x1875737775798016:12345-192.168.203.29@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788843235.625141:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+14:2359:x1875737775798016:12345-192.168.203.29@tcp:4:lhsmtool_posix.0 Request processed in 3500us (5862us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788843235.625160:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00002000:00100000:1.0:1788843235.625180:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8dab73ffa300 x1875737775798016/t4294967320(0) o4->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:606/0 lens 504/448 e 0 to 0 dl 1788843246 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788843235.625195:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab73ffa300 with x1875737775798016 ext(0->12) 00002000:00010000:1.0:1788843235.625205:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dab73ffa300 00000100:00100000:3.0:1788843235.627162:0:5831:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5831:1875737795703168:192.168.203.29@tcp:105: 00010000:00010000:3.0:1788843235.627212:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843235.627507:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+13:2358:x1875737775797888:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 22329us (31528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843235.627521:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 82 00000100:00100000:0.0:1788843235.639837:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843235.640059:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775798144 00000100:00100000:2.0:1788843235.640075:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775798144 00000100:00100000:2.0:1788843235.640177:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 227 00000100:00100000:2.0:1788843235.640192:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+66:11629:x1875737775798144:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788843235.657012:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42c27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795703296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843235.657129:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843235.657220:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795703296 00000100:00100000:3.0:1788843235.657230:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795703296 00000100:00100000:3.0:1788843235.657313:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788843235.657324:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab739ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875737795703296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788843235.657393:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788843235.657455:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab739ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875737795703296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843235.657464:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788843235.657908:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42c27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795703296:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788843235.662687:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788843235.750822:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1788843235.750849:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:0.0:1788843235.750895:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1788843235.750921:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1788843235.751761:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+39:11629:x1875737775798144:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 Request processed in 111560us (112004us total) trans 0 rc 0/0 00000001:00080000:0.0:1788843235.751766:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000100:00100000:2.0:1788843235.751778:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 227 00000004:00080000:0.0:1788843235.751788:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788843235.751809:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dab73b8ee40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788843235.751813:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dab44106400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dab73b8ef00 00000020:00080000:0.0:1788843235.751816:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dab44106300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dab77736800 00000020:00080000:0.0:1788843235.751842:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8daa41aeb000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788843235.751845:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dab7c1f9800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8daa41aebc00 00000020:00080000:0.0:1788843235.751848:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dab7c1f9a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8daa42b18800 00000020:00080000:3.0:1788843235.754627:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:0.0:1788843235.756565:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795703552:0@lo:6:osp-syn-0-0.0 00000020:00080000:3.0:1788843235.756860:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788843235.756881:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795703424:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788843235.757161:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795703680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788843235.757453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843235.757582:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795703424 00000100:00100000:3.0:1788843235.757594:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795703424 00000100:00100000:3.0:1788843235.757673:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788843235.757684:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875737795703424:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788843235.757731:0:6694:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1788843235.757799:0:6694:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f94e2, atime: 0x6a9f94e2, ctime: 0x6a9f94e2, blocks: 0x1 00010000:00010000:3.0:1788843235.757812:0:6694:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058da9800/0xc6b8ac1b0915bf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.757838:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1788843235.757844:0:6694:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843235.757861:0:6694:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058da9800/0xc6b8ac1b0915bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.757880:0:6694:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058da9800/0xc6b8ac1b0915bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.757892:0:6694:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058da9800/0xc6b8ac1b0915bf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.757901:0:6694:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058da9800/0xc6b8ac1b0915bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.757921:0:6694:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788843235.759797:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1875737795703424:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2096us (2327us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788843235.759819:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1788843235.759914:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843235.759928:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058da9800/0xc6b8ac1b0915bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.759948:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799f000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843235.759968:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058da9800/0xc6b8ac1b0915bf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.759984:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058da9800/0xc6b8ac1b0915bf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.760021:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058da9800/0xc6b8ac1b0915bf6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.760030:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058da9800/0xc6b8ac1b0915bf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.760063:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843235.760066:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843235.760068:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843235.761028:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000004:00080000:3.0:1788843235.762185:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dab73ff8380/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788843235.762209:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795703424:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788843235.762285:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775798272 00000100:00100000:3.0:1788843235.762297:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775798272 00000100:00100000:3.0:1788843235.762415:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:3.0:1788843235.762438:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+13:2359:x1875737775798272:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788843235.769105:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843235.770090:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795703552 00000100:00100000:2.0:1788843235.773600:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795703552 00000100:00100000:2.0:1788843235.774885:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788843235.774899:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3306:x1875737795703552:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788843235.774950:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:2.0:1788843235.774991:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0915bfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.775056:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b09159b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b2e expref: 13 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.775066:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:2.0:1788843235.775074:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788843235.775080:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0915bfd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843235.777822:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788843235.778776:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b09159b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b2e expref: 13 pid: 6694 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.778812:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b09159b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b2e expref: 13 pid: 6694 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843235.778836:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6693:1875737795703808:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843235.778969:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa1eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843235.782726:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795703680 00000100:00100000:1.0:1788843235.782754:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795703680 00000100:00100000:1.0:1788843235.782846:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788843235.782871:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1875737795703680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788843235.783221:0:8216:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788843235.783225:0:8216:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788843235 00002000:00010000:1.0:1788843235.783228:0:8216:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788843235.783230:0:8216:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788843235 -> 1788843235 00002000:00010000:1.0:1788843235.783234:0:8216:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788843235.783396:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3307:x1875737795703680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 529us (5591us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788843235.783405:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:1.0:1788843235.786936:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8daa42aef480/2, rc 0, transno 4294967321 00000100:00100000:1.0:1788843235.786962:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795703680:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788843235.804072:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6693:1875737795703808:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843235.804136:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0915bfd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843235.808013:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843235.808101:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775798400 00000100:00100000:2.0:1788843235.808126:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775798400 00010000:00010000:2.0:1788843235.808189:0:5832:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b09159b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b2e expref: 14 pid: 6694 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843235.808244:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 83 00000100:00100000:2.0:1788843235.808257:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+14:2359:x1875737775798400:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843235.808322:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843235.808329:0:5832:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b09159b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b2e expref: 14 pid: 6694 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.808793:0:5832:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b09159b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b2e expref: 14 pid: 6694 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.808828:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002d624381/0xc6b8ac1b09159b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b2e expref: 14 pid: 6694 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.808868:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788843235.808874:0:5832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788843235.808883:0:5832:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0915bfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.808895:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0915bfd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.808932:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843235.809012:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+13:2359:x1875737775798400:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 757us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843235.809023:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 83 00010000:00010000:2.0:1788843235.809071:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0915bfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.809081:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0915bfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.809103:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0915bfd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.809241:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0915bfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.809264:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788843235.810897:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3306:x1875737795703552:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35990us (41796us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788843235.810912:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:2.0:1788843235.810968:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843235.810979:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0915bfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.810995:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843235.811001:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0915bfd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.811018:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0915bfd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.811045:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0915bfd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.811054:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040840f04/0xc6b8ac1b0915bfd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.811095:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843235.811097:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843235.811100:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788843235.811385:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8daa42aef800/2, rc 0, transno 4294967322 00000100:00100000:0.0:1788843235.811398:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795703552:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1788843235.870331:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:2.0:1788843235.870532:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000100:00100000:0.0:1788843235.870805:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2359:x1875737775798272:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 Request processed in 108359us (109785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843235.870818:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:2.0:1788843235.875797:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843235.875974:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775798656 00000100:00100000:1.0:1788843235.875987:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775798656 00000100:00100000:1.0:1788843235.876097:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 228 00000100:00100000:1.0:1788843235.876117:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+20:11629:x1875737775798656:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788843235.876198:0:5847:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843235.876246:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915be1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bc1 expref: 20 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.876285:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dab43e63500) 00010000:00010000:1.0:1788843235.876292:0:5847:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843235.876330:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915c04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.876637:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915c04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.876649:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915c04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843235.876992:0:5847:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000078b7f12d reply state 0000000070154883 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915c04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843235.877004:0:5847:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788843235.877144:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+21:11629:x1875737775798656:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 1035us (1360us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1788843235.877153:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 228 00000100:00100000:3.0:1788843235.880718:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00010000:00010000:0.0:1788843235.881813:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915c04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.881835:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915c04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.881844:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915c04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.881852:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933be00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843235.881870:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915c04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.881880:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915c04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.881909:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dab43e63500) 00010000:00010000:0.0:1788843235.881913:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843235.881921:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915c04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.881927:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933be00/0xc6b8ac1b0915c04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843235.881999:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775798784 00000100:00100000:0.0:1788843235.882015:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775798784 00000100:00100000:0.0:1788843235.882123:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:0.0:1788843235.882139:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2358:x1875737775798784:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788843235.882842:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788843235.882849:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788843235 -> 1788843234 00002000:00010000:0.0:1788843235.882863:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788843234 00002000:00010000:0.0:1788843235.882866:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788843235 -> 1788843234 00002000:00010000:0.0:1788843235.882869:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788843235.882976:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2358:x1875737775798784:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 837us (2272us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788843235.882986:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:2.0:1788843235.889025:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843235.889189:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775799040 00000100:00100000:1.0:1788843235.889206:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775799040 00000100:00100000:2.0:1788843235.889791:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 229 00000100:00100000:2.0:1788843235.889807:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+20:11629:x1875737775799040:12345-192.168.203.29@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788843235.889925:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915c0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.889949:0:7168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b0915bc5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bb3 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.889961:0:7168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915c0b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.890007:0:7168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b0915bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bb3 expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.890024:0:7168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b0915bc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bb3 expref: 20 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843235.890040:0:7168:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7168:1875737795703936:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843235.890183:0:7168:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa1e780 going to sleep for 11 seconds 00000100:00100000:2.0:1788843235.902066:0:7168:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7168:1875737795703936:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843235.902137:0:7168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915c0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843235.902307:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843235.903205:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775799168 00000100:00100000:2.0:1788843235.903220:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775799168 00010000:00010000:2.0:1788843235.903284:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b0915bc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bb3 expref: 21 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843235.903333:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 84 00000100:00100000:2.0:1788843235.903382:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+21:2359:x1875737775799168:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843235.903404:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843235.903413:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b0915bc5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bb3 expref: 21 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.903439:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b0915bc5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bb3 expref: 21 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.903475:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e600/0xc6b8ac1b0915bc5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bb3 expref: 21 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.903499:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dab43e63500) 00010000:00010000:2.0:1788843235.903506:0:6708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915c0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.903517:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915c0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.903527:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915c0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.903587:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843235.903864:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+20:2359:x1875737775799168:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 511us (1549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843235.903873:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 84 00010000:00010000:0.0:1788843235.904230:0:7168:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915c0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.904241:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915c0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.904280:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915c0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.904288:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915c0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.904296:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915c0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.904304:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843235.904309:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915c0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.904317:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915c0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.904378:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dab43e63500) 00010000:00010000:0.0:1788843235.904382:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788843235.904387:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915c0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.904393:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374800/0xc6b8ac1b0915c0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843235.904653:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+19:11629:x1875737775799040:12345-192.168.203.29@tcp:55:lhsmtool_posix.0 Request processed in 14848us (15646us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788843235.904663:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 229 00000100:00100000:0.0:1788843235.913898:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843235.914028:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775799296 00000100:00100000:3.0:1788843235.914046:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775799296 00000100:00100000:3.0:1788843235.914140:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 70 00000100:00100000:3.0:1788843235.914153:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2359:x1875737775799296:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788843235.914220:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000058da9800/0xc6b8ac1b0915c12 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.914246:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915bef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bcf expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.914256:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788843235.914261:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788843235.914276:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058da9800/0xc6b8ac1b0915c12 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.914324:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915bef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bcf expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.914367:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915bef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bcf expref: 8 pid: 6693 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843235.914390:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42c24e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1875737795704064:192.168.203.29@tcp:104: 00000100:00100000:3.0:1788843235.914683:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab58e17f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843235.917545:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42c24e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6692:1875737795704064:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843235.917592:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000058da9800/0xc6b8ac1b0915c12 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843235.925742:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843235.926135:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775799424 00000100:00100000:2.0:1788843235.926150:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775799424 00010000:00010000:2.0:1788843235.926211:0:5831:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915bef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bcf expref: 9 pid: 6693 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843235.926281:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:2.0:1788843235.926296:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+9:2358:x1875737775799424:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843235.926319:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843235.926407:0:5831:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915bef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bcf expref: 9 pid: 6693 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.926427:0:5831:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915bef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bcf expref: 9 pid: 6693 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.926463:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c400c919/0xc6b8ac1b0915bef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bcf expref: 9 pid: 6693 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.926505:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788843235.926511:0:5831:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788843235.926520:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000058da9800/0xc6b8ac1b0915c12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.926562:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000058da9800/0xc6b8ac1b0915c12 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.926837:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843235.926940:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2358:x1875737775799424:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 646us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843235.926951:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 85 00010000:00010000:3.0:1788843235.933189:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000058da9800/0xc6b8ac1b0915c12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.933223:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000058da9800/0xc6b8ac1b0915c12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.933784:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000058da9800/0xc6b8ac1b0915c12 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.933797:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000058da9800/0xc6b8ac1b0915c12 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.933807:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000058da9800/0xc6b8ac1b0915c12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.933815:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799f000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843235.933821:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000058da9800/0xc6b8ac1b0915c12 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.933831:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000058da9800/0xc6b8ac1b0915c12 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.933875:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000058da9800/0xc6b8ac1b0915c12 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.933916:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000058da9800/0xc6b8ac1b0915c12 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843235.934065:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2359:x1875737775799296:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 Request processed in 19908us (20176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843235.934076:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 70 00000100:00100000:1.0:1788843235.940235:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843235.940540:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775799680 00000100:00100000:2.0:1788843235.940558:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775799680 00000100:00100000:2.0:1788843235.940768:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 230 00000100:00100000:2.0:1788843235.940784:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+19:11629:x1875737775799680:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788843235.940924:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915c19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.940952:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.940968:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.941829:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915c20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.941861:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915bd3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bba expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.941872:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915c20 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.941949:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915bd3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bba expref: 20 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.941970:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915bd3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bba expref: 20 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843235.941991:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795704192:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843235.942115:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa1e780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843235.947176:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843235.947309:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775799808 00000100:00100000:1.0:1788843235.947324:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775799808 00010000:00010000:1.0:1788843235.947432:0:7638:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915bd3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bba expref: 21 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843235.947483:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 86 00000100:00100000:1.0:1788843235.947496:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+21:2358:x1875737775799808:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843235.947518:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843235.947527:0:7638:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915bd3 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bba expref: 21 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.947545:0:7638:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915bd3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bba expref: 21 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.947619:0:7638:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dab43e63500) 00010000:00010000:1.0:1788843235.947628:0:7638:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915c20 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.947642:0:7638:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915c20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.947652:0:7638:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915c20 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.947683:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843235.947772:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+21:2358:x1875737775799808:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 278us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843235.947782:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 86 00010000:00010000:2.0:1788843235.948521:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915bd3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084bba expref: 20 pid: 5847 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843235.948550:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795704192:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843235.948590:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915c20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.948602:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915c20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.948609:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915c20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788843235.948955:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788843235.949160:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:2.0:1788843235.949216:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788843235.951039:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1875737795704320:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788843235.951161:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843235.951236:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa1e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788843235.951785:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795704320 00000100:00100000:1.0:1788843235.951802:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795704320 00000100:00100000:1.0:1788843235.953913:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788843235.953951:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5846:x1875737795704320:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788843235.954254:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5846:x1875737795704320:12345-0@lo:1000:mdt00_000.0 Request processed in 323us (3092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843235.957083:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788843235.957515:0:5846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:3.0:1788843235.957526:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:3.0:1788843235.957563:0:5846:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8daa42aef480 x1875737795703680/t4294967321(4294967321) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788843251 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843235.957583:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1875737795704320:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788843235.958912:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1788843235.959043:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1875737795704448:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788843235.959141:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843235.959294:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41adaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843235.959726:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795704448 00000100:00100000:3.0:1788843235.959738:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795704448 00000100:00100000:2.0:1788843235.959905:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788843235.959918:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5846:x1875737795704448:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788843235.960626:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5846:x1875737795704448:12345-0@lo:1000:mdt00_000.0 Request processed in 698us (1472us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788843235.960637:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788843235.960821:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5846:1875737795704448:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788843235.960893:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915c20 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.960907:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915c20 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.960918:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915c20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.960925:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843235.960931:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915c20 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.960940:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915c20 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.960988:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dab43e63500) 00010000:00010000:0.0:1788843235.960991:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788843235.960999:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915c20 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.961006:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375200/0xc6b8ac1b0915c20 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.961069:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915b63 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.961076:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915b63 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.961082:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915b63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.961088:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799ea00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843235.961090:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915b63 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.961096:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915b63 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.961105:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:0.0:1788843235.961108:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788843235.961117:0:5846:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b0915b6a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b9e expref: 23 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.961130:0:5846:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b0915b6a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b9e expref: 23 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.961152:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b0915b6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b9e expref: 23 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843235.961202:0:5846:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b0915b6a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b9e expref: 23 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843235.961219:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795704576:192.168.203.29@tcp:105: 00000100:00100000:0.0:1788843235.961635:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa4112a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843235.965273:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843235.965393:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775799936 00000100:00100000:3.0:1788843235.965406:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775799936 00000100:00100000:3.0:1788843235.965490:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:3.0:1788843235.965502:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+24:11627:x1875737775799936:12345-192.168.203.29@tcp:49:lfs.0 00000100:00100000:3.0:1788843235.965687:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+24:11627:x1875737775799936:12345-192.168.203.29@tcp:49:lfs.0 Request processed in 186us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843235.965695:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 61 00000100:00100000:1.0:1788843235.965939:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5846:1875737795704576:192.168.203.29@tcp:105: 00010000:00010000:1.0:1788843235.965989:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915b63 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.966005:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915b63 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.966089:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915c27 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.966111:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915c27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.966124:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915c27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.966136:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915c27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.966143:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915c27 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.966149:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915c27 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.966156:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843235.966160:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915c27 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.966168:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915c27 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.966184:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:1.0:1788843235.966187:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843235.966193:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915c27 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.966200:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915c27 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.966221:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915c19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.966227:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915c19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.966234:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915c19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.966240:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374c00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843235.966243:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915c19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.966250:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915c19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.966260:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:1.0:1788843235.966264:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788843235.966267:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915c19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843235.966273:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0915c19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843235.968124:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+23:11629:x1875737775799680:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 27331us (27896us total) trans 4294967513 rc 0/0 00000100:00100000:1.0:1788843235.968141:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 230 00000020:00080000:1.0:1788843235.968148:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788843235.968506:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788843235.968514:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788843235.969181:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788843235.969197:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788843235.973320:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843235.973640:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775800192 00000100:00100000:3.0:1788843235.973673:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775800192 00000100:00100000:3.0:1788843235.973758:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 62 00000100:00100000:3.0:1788843235.973771:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6640c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+23:11629:x1875737775800192:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788843235.975990:0:5849:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788843235.976143:0:5849:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:2.0:1788843235.976221:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b0915c2e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.976248:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b0915c2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.976280:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b0915c2e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.976294:0:5849:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b0915c2e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.976302:0:5849:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b0915c2e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.976310:0:5849:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b0915c2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843235.976711:0:5849:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788843235.976980:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6640c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+25:11629:x1875737775800192:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 3202us (3669us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1788843235.977008:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 62 00000020:00080000:2.0:1788843235.977018:0:5849:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788843235.977171:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843235.977181:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b0915c2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.977191:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375e00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843235.977197:0:7637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b0915c2e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.977206:0:7637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b0915c2e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.977225:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dab54910200) 00010000:00010000:3.0:1788843235.977228:0:7637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788843235.977234:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b0915c2e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.977240:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375e00/0xc6b8ac1b0915c2e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5849 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843235.977291:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843235.977294:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843235.977296:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843235.986519:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843235.987259:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775800448 00000100:00100000:2.0:1788843235.987290:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775800448 00000100:00100000:2.0:1788843235.987416:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 231 00000100:00100000:2.0:1788843235.987441:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+25:11627:x1875737775800448:12345-192.168.203.29@tcp:58:lfs.0 00000040:00080000:2.0:1788843235.988074:0:5848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1788843235.988190:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+25:11627:x1875737775800448:12345-192.168.203.29@tcp:58:lfs.0 Request processed in 751us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843235.988200:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 231 00000100:00100000:0.0:1788843236.048438:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843236.049054:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775800576 00000100:00100000:1.0:1788843236.049072:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775800576 00000100:00100000:1.0:1788843236.049215:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 232 00000100:00100000:1.0:1788843236.049230:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+25:11631:x1875737775800576:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:1.0:1788843236.049288:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843236.049318:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915c35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084bd6 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.049499:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915c3c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.049520:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915c3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.049536:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915c3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.049556:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915c43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.049564:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.049571:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.050172:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915c4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.050192:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b97 expref: 26 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.050204:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915c4a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.051433:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b97 expref: 26 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.051467:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b97 expref: 26 pid: 5848 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843236.051494:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aec380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1875737795704704:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843236.051834:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7793a180 going to sleep for 11 seconds 00000100:00100000:1.0:1788843236.055302:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aec380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5847:1875737795704704:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843236.055575:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915c4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843236.057592:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843236.059111:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775800832 00000100:00100000:0.0:1788843236.059136:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775800832 00000100:00100000:0.0:1788843236.059304:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:0.0:1788843236.059318:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+27:5596:x1875737775800832:12345-192.168.203.29@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788843236.060005:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+28:5596:x1875737775800832:12345-192.168.203.29@tcp:35:ldlm_bl.0 Request processed in 684us (2422us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788843236.060015:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 63 00000100:00100000:0.0:1788843236.067757:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843236.068002:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775800960 00000100:00100000:2.0:1788843236.068021:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775800960 00010000:00010000:2.0:1788843236.068089:0:6708:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b97 expref: 28 pid: 5848 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843236.068153:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 87 00000100:00100000:2.0:1788843236.068168:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+28:2358:x1875737775800960:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843236.068192:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843236.068200:0:6708:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b97 expref: 28 pid: 5848 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843236.068218:0:6708:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b97 expref: 28 pid: 5848 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843236.068252:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c4000/0xc6b8ac1b0915b55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084b97 expref: 28 pid: 5848 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843236.068311:0:6708:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:2.0:1788843236.068319:0:6708:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915c4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843236.068333:0:6708:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843236.068538:0:6708:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915c4a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843236.068584:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788843236.068729:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.068740:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843236.068811:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788843236.068818:0:5847:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788843236.068868:0:5847:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.068885:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915c4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.068897:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915c3c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.068918:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915c3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.068926:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915c3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.068933:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843236.068938:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915c3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.068948:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915c3c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.068959:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:1.0:1788843236.068962:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843236.068967:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915c3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.068973:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b000/0xc6b8ac1b0915c3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.068990:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.068998:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915c43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.069003:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.069008:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933a000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843236.069018:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.069025:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915c43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.069033:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dab61f39e00) 00010000:00010000:1.0:1788843236.069036:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843236.069040:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915c43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.069046:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915c43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.069097:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915c35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bd6 expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.069116:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915c4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bd6 expref: 27 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843236.069123:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:1.0:1788843236.069126:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843236.069129:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933bc00, rc 0) 00000100:00100000:1.0:1788843236.069212:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+27:11631:x1875737775800576:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 19984us (20794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843236.069222:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 232 00000100:00100000:2.0:1788843236.069828:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+26:2358:x1875737775800960:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 1660us (2087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843236.069893:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 87 00010000:00010000:2.0:1788843236.104589:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843236.676824:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795704960:0@lo:400:kworker.0 00000100:00100000:3.0:1788843236.676934:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843236.677033:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788843236.677044:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795704832:0@lo:400:kworker.0 00000100:00100000:3.0:1788843236.677085:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843236.677159:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795704960 00000100:00100000:3.0:1788843236.677169:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795704960 00000100:00100000:3.0:1788843236.677325:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788843236.677431:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795704960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843236.677774:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795704960:12345-0@lo:400:kworker.0 Request processed in 435us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843236.677787:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788843236.677910:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795704832 00000100:00100000:3.0:1788843236.677917:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795704832 00000100:00100000:3.0:1788843236.677947:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788843236.677954:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3305:x1875737795704832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843236.678128:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3305:x1875737795704832:12345-0@lo:400:kworker.0 Request processed in 172us (1039us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843236.678137:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788843236.678210:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42c24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795704832:0@lo:400:kworker.0 00000100:00100000:3.0:1788843236.678234:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42c25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795704960:0@lo:400:kworker.0 00000100:00100000:1.0:1788843236.678335:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795705216:0@lo:400:kworker.0 00000100:00100000:1.0:1788843236.678399:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843236.678439:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843236.678464:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7cd40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795705088:0@lo:400:kworker.0 00000100:00100000:1.0:1788843236.678497:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843236.678908:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795705216 00000100:00100000:1.0:1788843236.678916:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795705216 00000100:00100000:1.0:1788843236.678963:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795705088 00000100:00100000:1.0:1788843236.678970:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795705088 00000100:00100000:1.0:1788843236.679020:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788843236.679032:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795705216:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788843236.679199:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843236.679229:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795705216:12345-0@lo:400:kworker.0 Request processed in 197us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843236.679242:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788843236.679267:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788843236.679279:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795705088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843236.679329:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42aee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795705088:12345-0@lo:400:kworker.0 Request processed in 53us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843236.679749:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788843236.679835:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795705088:0@lo:400:kworker.0 00000100:00100000:1.0:1788843236.679862:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7cd42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795705216:0@lo:400:kworker.0 00000001:00080000:3.0:1788843236.786020:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1788843236.786038:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1788843236.786049:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000040:00080000:2.0:1788843237.014199:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788843237.014216:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788843237.014273:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788843237.014282:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788843237.014544:0:11689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875737795705344:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788843237.017498:0:11689:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7793ac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843237.027600:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843237.028247:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775801088 00000100:00100000:3.0:1788843237.028273:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775801088 00000100:00100000:3.0:1788843237.028445:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 233 00000100:00100000:3.0:1788843237.028461:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+27:11642:x1875737775801088:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788843237.028529:0:7168:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788843237.028881:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+27:11642:x1875737775801088:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 422us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843237.028899:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 233 00000100:00100000:3.0:1788843237.029250:0:11689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11689:1875737795705344:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00080000:2.0:1788843237.030008:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843237.040121:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843237.040457:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775801344 00000100:00100000:1.0:1788843237.040472:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775801344 00000100:00100000:1.0:1788843237.040793:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 234 00000100:00100000:1.0:1788843237.040807:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+26:11642:x1875737775801344:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788843237.040836:0:5847:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843237.040875:0:5847:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915c51 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084bdd expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843237.041062:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915c58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843237.041083:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843237.041103:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915c58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843237.041117:0:5847:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788843237.041289:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b800/0xc6b8ac1b0915c51 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bdd expref: 29 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843237.041315:0:5847:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915c58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bdd expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843237.041326:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:1.0:1788843237.041330:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788843237.041336:0:5847:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933a000, rc 0) 00000100:00100000:1.0:1788843237.041487:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+28:11642:x1875737775801344:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 682us (1380us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1788843237.041522:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 234 00000100:00100000:1.0:1788843237.048937:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843237.049021:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775801472 00000100:00100000:2.0:1788843237.049035:0:5832:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775801472 00000100:00100000:2.0:1788843237.049127:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:2.0:1788843237.049140:0:5832:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4886dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+28:2359:x1875737775801472:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843237.049175:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843237.049210:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a000/0xc6b8ac1b0915c58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bdd expref: 28 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843237.049232:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:2.0:1788843237.049238:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843237.049315:0:5832:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4886dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+27:2359:x1875737775801472:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 178us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843237.049323:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:3.0:1788843237.052711:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843237.052789:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775801728 00000100:00100000:0.0:1788843237.052802:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775801728 00000100:00100000:0.0:1788843237.052888:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 235 00000100:00100000:0.0:1788843237.052900:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+27:11642:x1875737775801728:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788843237.053042:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915c66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843237.053069:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915c66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843237.053083:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915c66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843237.053400:0:7168:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915c66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843237.053409:0:7168:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915c66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843237.053417:0:7168:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915c66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843237.053424:0:7168:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843237.053430:0:7168:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915c66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843237.053439:0:7168:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915c66 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843237.053455:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:0.0:1788843237.053459:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843237.053465:0:7168:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915c66 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843237.053472:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab821c5400/0xc6b8ac1b0915c66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843237.053929:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+28:11642:x1875737775801728:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 1027us (1229us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788843237.053941:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 235 00000040:00080000:3.0:1788843237.054078:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788843237.054083:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788843237.054994:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788843237.055024:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788843237.058475:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843237.058601:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775801984 00000100:00100000:2.0:1788843237.058627:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775801984 00000100:00100000:2.0:1788843237.058716:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 64 00000100:00100000:2.0:1788843237.058730:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+28:11642:x1875737775801984:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788843237.059190:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+29:11642:x1875737775801984:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 460us (726us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1788843237.059199:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 64 00010000:00010000:2.0:1788843237.124965:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843237.190532:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795705472:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843237.190613:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843237.190733:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795705472 00000100:00100000:3.0:1788843237.190743:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795705472 00000100:00100000:3.0:1788843237.190827:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788843237.190837:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795705472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788843237.190884:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788843237.190936:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7cd40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795705472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843237.190943:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788843237.190985:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1788843237.190992:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:3.0:1788843237.191017:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dab73ff8380, transno 4294967310 00000100:00100000:3.0:1788843237.191036:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795705472:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788843237.195912:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1788843237.217919:0:12620:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788843237.217928:0:12620:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843237.217972:0:12620:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788843237.217977:0:12620:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788843237.434974:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843237.440979:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775802240 00000100:00100000:0.0:1788843237.440997:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775802240 00000100:00100000:2.0:1788843237.441225:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 236 00000100:00100000:2.0:1788843237.441240:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+29:11655:x1875737775802240:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843237.441283:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843237.441310:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915c6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084be4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843237.441466:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0915c74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843237.441492:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0915c74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843237.441503:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0915c74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843237.441515:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788843237.441647:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0915c6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084be4 expref: 32 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843237.441675:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0915c74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084be4 expref: 31 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843237.441684:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:2.0:1788843237.441686:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788843237.441689:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375600, rc 0) 00000100:00100000:2.0:1788843237.441750:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+31:11655:x1875737775802240:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 514us (6788us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788843237.441757:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 236 00000100:00100000:0.0:1788843237.445289:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843237.445923:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775802368 00000100:00100000:3.0:1788843237.445934:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775802368 00000100:00100000:3.0:1788843237.445997:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 237 00000100:00100000:3.0:1788843237.446007:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+31:11655:x1875737775802368:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:3.0:1788843237.446081:0:5848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915c82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843237.446098:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843237.446109:0:5848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843237.446136:0:5848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843237.446143:0:5848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915c82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843237.446150:0:5848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915c82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843237.446156:0:5848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799ea00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843237.446160:0:5848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915c82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843237.446167:0:5848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915c82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843237.446179:0:5848:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:3.0:1788843237.446182:0:5848:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843237.446187:0:5848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915c82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843237.446193:0:5848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799ea00/0xc6b8ac1b0915c82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5848 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843237.446415:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+31:11655:x1875737775802368:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 407us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843237.446423:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 237 00000100:00100000:0.0:1788843237.557324:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843237.557551:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775802496 00000100:00100000:3.0:1788843237.557561:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775802496 00000100:00100000:3.0:1788843237.557628:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 71 00000100:00100000:3.0:1788843237.557639:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2356:x1875737775802496:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:3.0:1788843237.557657:0:12070:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843237.557679:0:12070:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee46e230/0xc6b8ac1b0915c89 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084beb expref: -99 pid: 12070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788843237.557708:0:12070:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f94e2, atime: 0x6a9f94e2, ctime: 0x6a9f94e2, blocks: 0xb 00010000:00010000:3.0:1788843237.557726:0:12070:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1788843237.557733:0:12070:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843237.557742:0:12070:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee46e230/0xc6b8ac1b0915c89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084beb expref: 8 pid: 12070 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843237.557759:0:12070:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ee46e230/0xc6b8ac1b0915c89 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084beb expref: 8 pid: 12070 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843237.557772:0:12070:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799ea00, rc 0) 00000100:00100000:3.0:1788843237.557835:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51454e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2356:x1875737775802496:12345-192.168.203.29@tcp:101:cat.0 Request processed in 198us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843237.557851:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 71 00000100:00080000:0.0:1788843237.558395:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843237.561857:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843237.563036:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775802624 00000100:00100000:2.0:1788843237.563049:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775802624 00002000:00100000:2.0:1788843237.563104:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8dab51457800 x1875737775802624/t0(0) o3->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:608/0 lens 488/0 e 0 to 0 dl 1788843248 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788843237.563117:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab51457800 with x1875737775802624 ext(0->4095) 00002000:00010000:2.0:1788843237.563123:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dab51457800 00000100:00100000:2.0:1788843237.563160:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1788843237.563170:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2357:x1875737775802624:12345-192.168.203.29@tcp:3:cat.0 00000100:00100000:2.0:1788843237.563932:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51457800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2357:x1875737775802624:12345-192.168.203.29@tcp:3:cat.0 Request processed in 760us (2089us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788843237.563942:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00002000:00100000:2.0:1788843237.563950:0:6699:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8dab51457800 x1875737775802624/t0(0) o3->fb38c5ab-0241-4970-81c2-7e93fb808128@192.168.203.29@tcp:608/0 lens 488/4536 e 0 to 0 dl 1788843248 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788843237.563958:0:6699:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dab51457800 with x1875737775802624 ext(0->4095) 00002000:00010000:2.0:1788843237.563962:0:6699:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dab51457800 00010000:00010000:2.0:1788843238.148899:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843239.182990:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843240.197283:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843240.601670:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843240.601735:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843240.601775:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843240.601798:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843240.601857:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843240.601896:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775803136 00000100:00100000:3.0:1788843240.601908:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775803136 00000100:00100000:3.0:1788843240.601973:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775803008 00000100:00100000:3.0:1788843240.601976:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775803008 00000100:00100000:3.0:1788843240.602001:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 93 00000100:00100000:3.0:1788843240.602013:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775803136:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843240.602109:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775803136:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 97us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843240.602119:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 93 00000100:00100000:3.0:1788843240.602139:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 94 00000100:00100000:3.0:1788843240.602161:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2359:x1875737775803008:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843240.602193:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+8:2359:x1875737775803008:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 34us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843240.602200:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 94 00000100:00080000:3.0:1788843240.602219:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788843240.602223:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843240.602681:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775802880 00000100:00100000:1.0:1788843240.602696:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775802880 00000100:00100000:1.0:1788843240.602748:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775803264 00000100:00100000:1.0:1788843240.602751:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775803264 00000100:00100000:1.0:1788843240.602776:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 158 00000100:00100000:1.0:1788843240.602784:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8daa42c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+31:2359:x1875737775802880:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843240.602842:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8daa42c25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+31:2359:x1875737775802880:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 59us (1187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843240.602849:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 158 00000100:00100000:1.0:1788843240.602866:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 159 00000100:00100000:1.0:1788843240.602873:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775803264:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843240.602900:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2359:x1875737775803264:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 28us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843240.602907:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 159 00000100:00100000:1.0:1788843240.602929:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775802752 00000100:00100000:1.0:1788843240.602933:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775802752 00000100:00100000:1.0:1788843240.602961:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 294 00000100:00100000:1.0:1788843240.602969:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2359:x1875737775802752:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843240.602997:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48998450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2359:x1875737775802752:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 29us (1221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843240.603004:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 294 00000100:00080000:3.0:1788843240.605215:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843240.783458:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795705600:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843240.783560:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843240.800531:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795705600 00000100:00100000:1.0:1788843240.800551:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795705600 00000100:00100000:1.0:1788843240.800687:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788843240.800699:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3305:x1875737795705600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843240.800754:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843240.800876:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3305:x1875737795705600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 179us (17316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843240.800894:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:3.0:1788843240.808115:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843240.808377:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795705600:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788843240.904051:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000001:00080000:0.0:1788843240.904083:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1788843240.904102:0:5868:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8daa41ada180 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788843240.904110:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dab7fc7d400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8daa41ada9c0 00000020:00080000:0.0:1788843240.904114:0:5868:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dab7fc7da00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dab45687400 00000020:00080000:0.0:1788843240.904150:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788843240.907046:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788843240.913506:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:2.0:1788843240.932530:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:2.0:1788843240.932674:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:2.0:1788843240.932684:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000040:00080000:3.0:1788843241.160306:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788843241.160330:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788843241.160778:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788843241.160787:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788843241.224203:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843241.800934:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795705728:0@lo:400:kworker.0 00000100:00100000:0.0:1788843241.801035:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843241.801110:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795706240:0@lo:400:kworker.0 00000100:00100000:0.0:1788843241.801157:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843241.801192:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788843241.801200:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795705856:0@lo:400:kworker.0 00000100:00100000:0.0:1788843241.801225:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843241.801246:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795706368:0@lo:400:kworker.0 00000100:00100000:0.0:1788843241.801304:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843241.801372:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795706240 00000100:00100000:0.0:1788843241.801629:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795706240 00000100:00100000:0.0:1788843241.801705:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795705856 00000100:00100000:0.0:1788843241.801708:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795705856 00000100:00100000:0.0:1788843241.801734:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788843241.801746:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795706240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843241.801822:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51455180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795706240:12345-0@lo:400:kworker.0 Request processed in 68us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843241.801831:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788843241.801849:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788843241.801856:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795705856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843241.801885:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51456d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795705856:12345-0@lo:400:kworker.0 Request processed in 30us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843241.801892:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788843241.801919:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795706368 00000100:00100000:0.0:1788843241.801923:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795706368 00000100:00100000:0.0:1788843241.801957:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788843241.801964:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795706368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843241.801997:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51455c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795706368:12345-0@lo:400:kworker.0 Request processed in 33us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843241.802004:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788843241.802052:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795705856:0@lo:400:kworker.0 00000100:00100000:0.0:1788843241.802065:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795706368:0@lo:400:kworker.0 00000100:00100000:0.0:1788843241.802074:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795706240:0@lo:400:kworker.0 00000100:00100000:1.0:1788843241.802246:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795705728 00000100:00100000:1.0:1788843241.802251:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795705728 00000100:00100000:1.0:1788843241.802295:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788843241.802303:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795705728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843241.802375:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48999850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795705728:12345-0@lo:400:kworker.0 Request processed in 73us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843241.802395:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788843241.804061:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795705728:0@lo:400:kworker.0 00000100:00100000:3.0:1788843241.804517:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795705984:0@lo:400:kworker.0 00000100:00100000:3.0:1788843241.804603:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843241.804653:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843241.804660:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795706112:0@lo:400:kworker.0 00000100:00100000:3.0:1788843241.804688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788843241.804740:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843241.804748:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843241.804767:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795705984 00000100:00100000:3.0:1788843241.804773:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795705984 00000100:00100000:3.0:1788843241.804851:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788843241.804861:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7778c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795705984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843241.804923:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7778c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795705984:12345-0@lo:400:kworker.0 Request processed in 62us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843241.804931:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:3.0:1788843241.804952:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843241.805310:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795705984:0@lo:400:kworker.0 00000100:00100000:1.0:1788843241.806420:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795706112 00000100:00100000:1.0:1788843241.806431:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795706112 00000100:00100000:1.0:1788843241.806500:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788843241.806511:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795706112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843241.806603:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795706112:12345-0@lo:400:kworker.0 Request processed in 94us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843241.806611:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788843241.813704:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1788843241.813724:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8daa42aef480, transno 4294967321 00000004:00080000:3.0:1788843241.813965:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8daa42aef800, transno 4294967322 00000004:00080000:3.0:1788843241.813974:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1788843241.814015:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795706112:0@lo:400:kworker.0 00010000:00010000:2.0:1788843242.250648:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843242.308598:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795706496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788843242.308691:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843242.310386:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795706496 00000100:00100000:0.0:1788843242.310402:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795706496 00000100:00100000:0.0:1788843242.310457:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788843242.310469:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795706496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843242.310519:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843242.310612:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795706496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (1921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843242.310620:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788843242.312977:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795706496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843242.938669:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843242.938780:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775803392 00000100:00100000:0.0:1788843242.938792:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775803392 00000100:00100000:0.0:1788843242.938887:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 238 00000100:00100000:0.0:1788843242.938899:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+18:11308:x1875737775803392:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788843242.939028:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+18:11308:x1875737775803392:12345-192.168.203.29@tcp:60:lhsmtool_posix.0 Request processed in 131us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843242.939036:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 238 00000100:00080000:3.0:1788843242.945494:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843242.948281:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843242.948513:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775803648 00000100:00100000:3.0:1788843242.948523:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775803648 00000100:00100000:2.0:1788843242.948756:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 65 00000100:00100000:2.0:1788843242.948768:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+18:11308:x1875737775803648:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788843242.949140:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+19:11308:x1875737775803648:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 374us (870us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788843242.949148:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 65 00010000:00010000:2.0:1788843243.269064:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843243.309950:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843243.310120:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775803776 00000100:00100000:2.0:1788843243.310143:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775803776 00000100:00100000:2.0:1788843243.310289:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 239 00000100:00100000:2.0:1788843243.310304:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab51457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:12106:x1875737775803776:12345-192.168.203.29@tcp:101:lsof.0 00010000:00010000:2.0:1788843243.310331:0:7168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843243.310409:0:7168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b0915c90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084bf2 expref: -99 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843243.310503:0:7168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915c97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843243.310521:0:7168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915c97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843243.310535:0:7168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915c97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788843243.310680:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:2.0:1788843243.312133:0:7168:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788843243.312143:0:7168:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843243.312194:0:7168:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915c97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7168 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843243.312234:0:7168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375800/0xc6b8ac1b0915c90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bf2 expref: 7 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843243.312278:0:7168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915c97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bf2 expref: 6 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843243.312288:0:7168:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab61f39400) 00010000:00010000:2.0:1788843243.312291:0:7168:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843243.312295:0:7168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374e00, rc 0) 00000100:00100000:2.0:1788843243.312443:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab51457480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:12106:x1875737775803776:12345-192.168.203.29@tcp:101:lsof.0 Request processed in 2142us (2516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843243.312466:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 239 00010000:00010000:2.0:1788843244.293039:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843245.318622:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843245.717625:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843245.717674:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843245.717723:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843245.717754:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843245.717779:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843245.718043:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775803904 00000100:00100000:3.0:1788843245.718060:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775803904 00000100:00100000:3.0:1788843245.718143:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 296 00000100:00100000:3.0:1788843245.718155:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2356:x1875737775803904:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843245.718253:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2356:x1875737775803904:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 100us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843245.718261:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 296 00000100:00100000:0.0:1788843245.718506:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775804160 00000100:00100000:0.0:1788843245.718513:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775804160 00000100:00100000:0.0:1788843245.718571:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775804288 00000100:00100000:0.0:1788843245.718575:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775804288 00000100:00100000:0.0:1788843245.718605:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 97 00000100:00100000:0.0:1788843245.718613:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2356:x1875737775804160:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843245.718650:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2356:x1875737775804160:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 38us (975us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843245.718657:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 97 00000100:00100000:0.0:1788843245.718690:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 98 00000100:00100000:0.0:1788843245.718697:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2356:x1875737775804288:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843245.718723:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2356:x1875737775804288:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 26us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843245.718729:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 98 00000100:00100000:0.0:1788843245.718751:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775804416 00000100:00100000:0.0:1788843245.718754:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775804416 00000100:00100000:0.0:1788843245.718800:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775804032 00000100:00100000:0.0:1788843245.718803:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775804032 00000100:00100000:0.0:1788843245.718824:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 163 00000100:00100000:0.0:1788843245.718830:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:2356:x1875737775804416:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843245.718861:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:2356:x1875737775804416:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 31us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843245.718867:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 163 00000100:00100000:0.0:1788843245.718879:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 164 00000100:00100000:0.0:1788843245.718886:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+19:2356:x1875737775804032:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843245.718917:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+19:2356:x1875737775804032:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 32us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843245.718924:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 164 00000100:00080000:3.0:1788843245.721308:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788843245.721320:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843245.721324:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843245.893965:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795706624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843245.894047:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843245.894162:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795706624 00000100:00100000:1.0:1788843245.894175:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795706624 00000100:00100000:1.0:1788843245.894234:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788843245.894244:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795706624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843245.894296:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843245.894373:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795706624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843245.894382:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:1.0:1788843245.894491:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843245.894533:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795706624:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788843245.994033:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:3.0:1788843245.994048:0:5868:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788843245.994581:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788843245.994594:0:5879:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788843246.340748:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843246.917126:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795706880:0@lo:400:kworker.0 00000100:00100000:0.0:1788843246.917253:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843246.917329:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c0a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795707392:0@lo:400:kworker.0 00000100:00100000:0.0:1788843246.917393:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843246.917435:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788843246.917441:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795706752:0@lo:400:kworker.0 00000100:00100000:0.0:1788843246.917485:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843246.917515:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c0a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795707264:0@lo:400:kworker.0 00000100:00100000:0.0:1788843246.917542:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843246.917571:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795707008:0@lo:400:kworker.0 00000100:00100000:0.0:1788843246.917599:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843246.917621:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843246.917627:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8daa42aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795707136:0@lo:400:kworker.0 00000100:00100000:0.0:1788843246.917651:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843246.917701:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795706880 00000100:00100000:0.0:1788843246.917714:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795706880 00000100:00100000:0.0:1788843246.917822:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795707264 00000100:00100000:0.0:1788843246.917826:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795707264 00000100:00100000:0.0:1788843246.917855:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795707008 00000100:00100000:0.0:1788843246.917859:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795707008 00000100:00100000:0.0:1788843246.917877:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788843246.917887:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795706880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843246.917978:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875737795706880:12345-0@lo:400:kworker.0 Request processed in 91us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843246.917988:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1788843246.918011:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788843246.918017:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795707264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843246.918046:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795707264:12345-0@lo:400:kworker.0 Request processed in 30us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843246.918051:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788843246.918062:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788843246.918068:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795707008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843246.918115:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795707008:12345-0@lo:400:kworker.0 Request processed in 46us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843246.918122:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788843246.918146:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795707392 00000100:00100000:0.0:1788843246.918151:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795707392 00000100:00100000:0.0:1788843246.918180:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795707136 00000100:00100000:0.0:1788843246.918183:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795707136 00000100:00100000:0.0:1788843246.918203:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788843246.918210:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795707392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843246.918247:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795707392:12345-0@lo:400:kworker.0 Request processed in 37us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843246.918253:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788843246.918265:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788843246.918271:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795707136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843246.918301:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795707136:12345-0@lo:400:kworker.0 Request processed in 31us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843246.918307:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788843246.918331:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795706752 00000100:00100000:0.0:1788843246.918334:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795706752 00000100:00100000:0.0:1788843246.918388:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788843246.918395:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795706752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843246.918428:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795706752:12345-0@lo:400:kworker.0 Request processed in 34us (944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843246.918435:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:0.0:1788843246.918482:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788843246.918488:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843246.918914:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795707136:0@lo:400:kworker.0 00000100:00100000:0.0:1788843246.918945:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795707008:0@lo:400:kworker.0 00000100:00100000:0.0:1788843246.919069:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795706752:0@lo:400:kworker.0 00000100:00100000:0.0:1788843246.919085:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c0a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795707264:0@lo:400:kworker.0 00000100:00100000:0.0:1788843246.919097:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8daa42aef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875737795706880:0@lo:400:kworker.0 00000100:00100000:0.0:1788843246.919111:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c0a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795707392:0@lo:400:kworker.0 00000001:02000400:2.0:1788843247.328495:0:12823:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 00:54:05 (1788843245) 00010000:00010000:2.0:1788843247.364571:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843247.428785:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795707520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843247.428893:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843247.429023:0:8474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795707520 00000100:00100000:1.0:1788843247.429034:0:8474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795707520 00000100:00100000:1.0:1788843247.429102:0:8474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788843247.429116:0:8474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795707520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843247.429160:0:8474:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843247.429244:0:8474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795707520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843247.429252:0:8474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788843247.429396:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795707520:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788843248.391295:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843249.412658:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843250.436748:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843250.833241:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843250.833289:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843250.833429:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843250.833450:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843250.833487:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843250.833502:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775805056 00000100:00100000:0.0:1788843250.833520:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775805056 00000100:00100000:3.0:1788843250.833542:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775804544 00000100:00100000:3.0:1788843250.833564:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775804544 00000100:00100000:0.0:1788843250.833631:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775804672 00000100:00100000:3.0:1788843250.833632:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 298 00000100:00100000:0.0:1788843250.833638:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775804672 00000100:00100000:3.0:1788843250.833661:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4899b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2359:x1875737775804544:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843250.833683:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 168 00000100:00100000:0.0:1788843250.833697:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:2359:x1875737775805056:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843250.833743:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4899b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2359:x1875737775804544:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 85us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843250.833762:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 298 00000100:00100000:0.0:1788843250.833786:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:2359:x1875737775805056:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 91us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843250.833797:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 168 00000100:00100000:0.0:1788843250.833969:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 169 00000100:00100000:0.0:1788843250.833979:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+18:2359:x1875737775804672:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843250.834010:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+18:2359:x1875737775804672:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 34us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843250.834017:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 169 00000100:00080000:0.0:1788843250.841506:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843250.849452:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775804800 00000100:00100000:2.0:1788843250.849469:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775804800 00000100:00080000:1.0:1788843250.849956:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843250.850291:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775804928 00000100:00100000:2.0:1788843250.850297:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775804928 00000100:00100000:2.0:1788843250.850386:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 101 00000100:00100000:2.0:1788843250.850400:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2359:x1875737775804800:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843250.850487:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2359:x1875737775804800:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 90us (17196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843250.850495:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 101 00000100:00100000:2.0:1788843250.850513:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 102 00000100:00100000:2.0:1788843250.850521:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775804928:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843250.850564:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2359:x1875737775804928:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 44us (17079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843250.850585:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 102 00000100:00080000:1.0:1788843250.850860:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843251.012699:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7766ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795707648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843251.012779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843251.013426:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795707648 00000100:00100000:1.0:1788843251.013437:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795707648 00000100:00100000:1.0:1788843251.013510:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788843251.013519:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795707648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843251.013554:0:6696:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843251.013619:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795707648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843251.013635:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788843251.013864:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843251.014224:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7766ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795707648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843251.082050:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843251.082372:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775805312 00000100:00100000:1.0:1788843251.082385:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775805312 00000100:00100000:1.0:1788843251.082497:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:1.0:1788843251.082509:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+18:12328:x1875737775805312:12345-192.168.203.29@tcp:35:umount.0 00000100:00100000:1.0:1788843251.082907:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fb38c5ab-0241-4970-81c2-7e93fb808128+19:12328:x1875737775805312:12345-192.168.203.29@tcp:35:umount.0 Request processed in 399us (866us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788843251.082915:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 66 00000100:00100000:2.0:1788843251.094185:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843251.094382:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775805568 00000100:00100000:0.0:1788843251.094398:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775805568 00000100:00100000:0.0:1788843251.094471:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 67 00000100:00100000:0.0:1788843251.094501:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+19:12328:x1875737775805568:12345-192.168.203.29@tcp:35:umount.0 00000100:00100000:0.0:1788843251.094944:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+20:12328:x1875737775805568:12345-192.168.203.29@tcp:35:umount.0 Request processed in 445us (775us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788843251.094961:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 67 00000100:00100000:3.0:1788843251.101727:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843251.102424:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775805824 00000100:00100000:0.0:1788843251.102437:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775805824 00000100:00100000:0.0:1788843251.102505:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 68 00000100:00100000:0.0:1788843251.102516:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab66408450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+20:12328:x1875737775805824:12345-192.168.203.29@tcp:35:umount.0 00000100:00100000:0.0:1788843251.102788:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab66408450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+21:12328:x1875737775805824:12345-192.168.203.29@tcp:35:umount.0 Request processed in 273us (1068us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788843251.102796:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 68 00000100:00100000:3.0:1788843251.109585:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843251.110008:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775806080 00000100:00100000:2.0:1788843251.110021:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775806080 00000100:00100000:2.0:1788843251.110089:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:2.0:1788843251.110100:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+21:12328:x1875737775806080:12345-192.168.203.29@tcp:35:umount.0 00000100:00100000:2.0:1788843251.110526:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fb38c5ab-0241-4970-81c2-7e93fb808128+22:12328:x1875737775806080:12345-192.168.203.29@tcp:35:umount.0 Request processed in 427us (950us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788843251.110534:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 69 00000100:00100000:2.0:1788843251.118736:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843251.118784:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843251.118819:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843251.118971:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775806208 00000100:00100000:1.0:1788843251.118983:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775806208 00000100:00100000:1.0:1788843251.119037:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775806464 00000100:00100000:1.0:1788843251.119041:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775806464 00000100:00100000:1.0:1788843251.119061:0:7638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775806336 00000100:00100000:1.0:1788843251.119063:0:7638:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775806336 00000100:00100000:1.0:1788843251.119080:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:1.0:1788843251.119089:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+15:2358:x1875737775806208:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843251.119107:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843251.119129:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7ff88600/0xc6b8ac1b0914cad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708477d expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843251.119147:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843251.119203:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+14:2358:x1875737775806208:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 114us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843251.119209:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:1.0:1788843251.119239:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:1.0:1788843251.119245:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+13:2356:x1875737775806464:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843251.119268:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843251.119278:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab41532400/0xc6b8ac1b0914ef9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084848 expref: 13 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843251.119287:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843251.119306:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:2356:x1875737775806464:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 62us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843251.119312:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:1.0:1788843251.119335:0:7638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:1.0:1788843251.119382:0:7638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+11:2358:x1875737775806336:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843251.119390:0:7638:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843251.119400:0:7638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7ff89000/0xc6b8ac1b0914c75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084745 expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843251.119408:0:7638:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843251.119426:0:7638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2358:x1875737775806336:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 85us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843251.119431:0:7638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:3.0:1788843251.126070:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843251.126326:0:8216:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775806592 00000100:00100000:0.0:1788843251.126335:0:8216:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775806592 00000100:00100000:0.0:1788843251.126422:0:8216:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 72 00000100:00100000:0.0:1788843251.126432:0:8216:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2355:x1875737775806592:12345-192.168.203.29@tcp:9:umount.0 00000020:00000080:0.0:1788843251.126761:0:8216:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914fe7 00000100:00080000:0.0:1788843251.126773:0:8216:0:(import.c:65:import_set_state_nolock()) ffff8dab452b3800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1788843251.127047:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788843251.127069:0:8216:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788843251.128104:0:8216:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fb38c5ab-0241-4970-81c2-7e93fb808128+2:2355:x1875737775806592:12345-192.168.203.29@tcp:9:umount.0 Request processed in 1668us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843251.128117:0:8216:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 72 00000100:00100000:1.0:1788843251.133004:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843251.133245:0:12070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775806976 00000100:00100000:2.0:1788843251.133254:0:12070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775806976 00000100:00100000:2.0:1788843251.133313:0:12070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 73 00000100:00100000:2.0:1788843251.133323:0:12070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7766f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2355:x1875737775806976:12345-192.168.203.29@tcp:9:umount.0 00000020:00000080:2.0:1788843251.133784:0:12070:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b091524f 00000020:00010000:2.0:1788843251.133794:0:12070:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dab60259800: total 0 00000100:00080000:2.0:1788843251.133799:0:12070:0:(import.c:65:import_set_state_nolock()) ffff8dab6025f000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788843251.133883:0:12070:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788843251.134178:0:12070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7766f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:fb38c5ab-0241-4970-81c2-7e93fb808128+5:2355:x1875737775806976:12345-192.168.203.29@tcp:9:umount.0 Request processed in 854us (1181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843251.134187:0:12070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 73 00000020:00010000:3.0:1788843251.136012:0:5834:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dab60259800: total 0 00010000:00010000:3.0:1788843251.136068:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dab60259800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788843251.136125:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee46e230/0xc6b8ac1b0915c89 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084beb expref: 4 pid: 12070 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843251.136169:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000081bee96/0xc6b8ac1b09155eb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a1d expref: 3 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843251.136188:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dab60259800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788843251.136201:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843251.136203:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843251.136205:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843251.148331:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843251.149038:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775808000 00000100:00100000:0.0:1788843251.149049:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775808000 00000100:00100000:0.0:1788843251.149174:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 240 00000100:00100000:0.0:1788843251.149186:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+22:2355:x1875737775808000:12345-192.168.203.29@tcp:39:umount.0 00000020:00000080:0.0:1788843251.149250:0:5848:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914c83 00000020:00010000:0.0:1788843251.149267:0:5848:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dab7c18f000: total 0 00000100:00080000:0.0:1788843251.149272:0:5848:0:(import.c:65:import_set_state_nolock()) ffff8dab7c18d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788843251.149307:0:5848:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1788843251.150779:0:7639:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dab7c18f000: total 0 00010000:00010000:3.0:1788843251.150842:0:7639:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dab7c18f000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788843251.150885:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:3.0:1788843251.150889:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843251.150901:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f800/0xc6b8ac1b0915b6a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b9e expref: 21 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843251.150924:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:3.0:1788843251.150927:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788843251.150930:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88000/0xc6b8ac1b09152aa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084944 expref: 20 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843251.150980:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:3.0:1788843251.150983:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788843251.150987:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0915669 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a40 expref: 19 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843251.151016:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:3.0:1788843251.151018:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788843251.151022:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b0915948 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084b12 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843251.151043:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:3.0:1788843251.151045:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843251.151050:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ae00/0xc6b8ac1b09154cc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070849d0 expref: 17 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843251.151062:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:3.0:1788843251.151064:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788843251.151068:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b0914fbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084872 expref: 16 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843251.151087:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:3.0:1788843251.151090:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843251.151094:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933bc00/0xc6b8ac1b0915c4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bd6 expref: 15 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843251.151109:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab61f39400) 00010000:00010000:3.0:1788843251.151111:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843251.151122:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933ac00/0xc6b8ac1b091564d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a39 expref: 14 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843251.151138:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab61f39d00) 00010000:00010000:3.0:1788843251.151141:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843251.151144:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0914f69 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c60708485d expref: 13 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843251.151174:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:3.0:1788843251.151177:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788843251.151181:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88200/0xc6b8ac1b09155ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a08 expref: 12 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843251.151193:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dab43e63a00) 00010000:00010000:3.0:1788843251.151196:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843251.151199:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054a00/0xc6b8ac1b0914f4d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084856 expref: 11 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843251.151213:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dab61f39600) 00010000:00010000:3.0:1788843251.151216:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788843251.151219:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b200/0xc6b8ac1b09155d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084a16 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843251.151245:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dab54910e00) 00010000:00010000:3.0:1788843251.151248:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788843251.151251:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0915c74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084be4 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843251.151267:0:7639:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dab7c18f000, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788843251.151288:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843251.151290:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843251.151292:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843251.152078:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fb38c5ab-0241-4970-81c2-7e93fb808128+7:2355:x1875737775808000:12345-192.168.203.29@tcp:39:umount.0 Request processed in 2758us (3622us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788843251.152097:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 240 00000040:00080000:3.0:1788843251.396736:0:11689:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788843251.396756:0:11689:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788843251.397371:0:11689:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788843251.397380:0:11689:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788843251.464600:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843252.037808:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7766ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795707776:0@lo:400:kworker.0 00000100:00100000:3.0:1788843252.037885:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843252.037955:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795708288:0@lo:400:kworker.0 00000100:00100000:3.0:1788843252.037992:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843252.038016:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788843252.038023:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795707904:0@lo:400:kworker.0 00000100:00100000:3.0:1788843252.038070:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843252.038086:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795708416:0@lo:400:kworker.0 00000100:00100000:3.0:1788843252.038109:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843252.038146:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795708416 00000100:00100000:3.0:1788843252.038153:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795708416 00000100:00100000:3.0:1788843252.038219:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788843252.038228:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795708416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843252.038285:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795708416:12345-0@lo:400:kworker.0 Request processed in 58us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843252.038305:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:3.0:1788843252.038328:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843252.038796:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795708032:0@lo:400:kworker.0 00000100:00100000:2.0:1788843252.038833:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843252.038886:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795708288 00000100:00100000:2.0:1788843252.038890:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795708288 00000100:00100000:2.0:1788843252.038930:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795707904 00000100:00100000:2.0:1788843252.038933:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795707904 00000100:00100000:2.0:1788843252.038945:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795708032 00000100:00100000:2.0:1788843252.038948:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795708032 00000100:00100000:2.0:1788843252.038974:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788843252.038983:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795708288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843252.039022:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795708288:12345-0@lo:400:kworker.0 Request processed in 41us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843252.039028:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788843252.039042:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788843252.039047:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795707904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843252.039076:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795707904:12345-0@lo:400:kworker.0 Request processed in 29us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843252.039082:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788843252.039093:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788843252.039099:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795708032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843252.039130:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795708032:12345-0@lo:400:kworker.0 Request processed in 32us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843252.039136:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788843252.039246:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795708160:0@lo:400:kworker.0 00000100:00100000:3.0:1788843252.039280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843252.039825:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795707776 00000100:00100000:1.0:1788843252.039832:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795707776 00000100:00100000:1.0:1788843252.039874:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788843252.039882:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795707776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843252.039928:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48998c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:28cf63da-daee-485f-b466-4ec68876f732+19:3306:x1875737795707776:12345-0@lo:400:kworker.0 Request processed in 48us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843252.039935:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788843252.040044:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795708032:0@lo:400:kworker.0 00000100:00100000:1.0:1788843252.040070:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795708160 00000100:00100000:1.0:1788843252.040073:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795708160 00000100:00100000:1.0:1788843252.040099:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788843252.040105:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795708160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843252.040136:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795708160:12345-0@lo:400:kworker.0 Request processed in 31us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843252.040142:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788843252.040269:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795708160:0@lo:400:kworker.0 00000100:00080000:3.0:1788843252.040310:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788843252.040332:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795707904:0@lo:400:kworker.0 00000100:00100000:3.0:1788843252.044052:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795708416:0@lo:400:kworker.0 00000100:00100000:3.0:1788843252.044085:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7766ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795707776:0@lo:400:kworker.0 00000100:00100000:3.0:1788843252.044097:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795708288:0@lo:400:kworker.0 00000001:00100000:3.0:1788843252.112018:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fb38c5ab-0241-4970-81c2-7e93fb808128 00000020:00000080:3.0:1788843252.112028:0:7650:0:(genops.c:885:class_export_put()) final put ffff8dab452b1800/fb38c5ab-0241-4970-81c2-7e93fb808128 00000020:00000080:0.0:1788843252.112222:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab452b1800/fb38c5ab-0241-4970-81c2-7e93fb808128 for lustre-OST0001 00000020:00000080:0.0:1788843252.112443:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab452b3800 for lustre-OST0001 00010000:00010000:2.0:1788843252.488544:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843252.548978:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788843252.549001:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bcadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795708544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843252.549068:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843252.549390:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795708544 00000100:00100000:2.0:1788843252.549398:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795708544 00000100:00100000:2.0:1788843252.549455:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788843252.549464:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795708544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788843252.549510:0:6697:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788843252.549571:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795708544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843252.549585:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788843252.549683:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bcadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795708544:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843252.604611:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843252.604656:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843252.604686:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843252.605248:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775808128 00000100:00100000:3.0:1788843252.605261:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775808128 00000100:00100000:3.0:1788843252.605332:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775808384 00000100:00100000:3.0:1788843252.605335:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775808384 00000100:00100000:3.0:1788843252.605376:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775808256 00000100:00100000:3.0:1788843252.605379:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775808256 00000100:00100000:3.0:1788843252.605394:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1788843252.605403:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+12:2358:x1875737775808128:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843252.605416:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843252.605434:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7ff88c00/0xc6b8ac1b0914d55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084792 expref: 12 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843252.605460:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843252.605504:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+11:2358:x1875737775808128:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 103us (904us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843252.605511:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:3.0:1788843252.605526:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:3.0:1788843252.605532:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+10:2358:x1875737775808384:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843252.605553:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843252.605562:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7ff89c00/0xc6b8ac1b0914ef2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084841 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843252.605570:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843252.605587:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+9:2358:x1875737775808384:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 55us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843252.605593:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:3.0:1788843252.605605:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:3.0:1788843252.605611:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+8:2358:x1875737775808256:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843252.605618:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843252.605626:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7ff89200/0xc6b8ac1b0914d5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c6070847bc expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843252.605634:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843252.605649:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+7:2358:x1875737775808256:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 38us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843252.605654:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:1.0:1788843252.615830:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843252.616084:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775808640 00000100:00100000:2.0:1788843252.616093:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775808640 00000100:00080000:3.0:1788843252.616255:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843252.616323:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 241 00000100:00100000:2.0:1788843252.616337:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bcae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+6:2355:x1875737775808640:12345-192.168.203.29@tcp:39:umount.0 00000020:00000080:2.0:1788843252.616430:0:5847:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914d6a 00000020:00010000:2.0:1788843252.616437:0:5847:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dab77a7d800: total 0 00000100:00080000:2.0:1788843252.616442:0:5847:0:(import.c:65:import_set_state_nolock()) ffff8dab77a7b800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788843252.616477:0:5847:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1788843252.616698:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bcae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b6d1c4e8-7f8e-438b-8c74-80bf75c52b59+5:2355:x1875737775808640:12345-192.168.203.29@tcp:39:umount.0 Request processed in 363us (875us total) trans 4294967527 rc 0/0 00000020:00010000:3.0:1788843252.616750:0:5834:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dab77a7d800: total 0 00010000:00010000:3.0:1788843252.616803:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dab77a7d800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788843252.616838:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab61f39400) 00010000:00010000:3.0:1788843252.616841:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843252.616849:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0915c97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084bf2 expref: 5 pid: 7168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843252.616882:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dab77a7d800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788843252.616924:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843252.616926:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843252.616927:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843252.618800:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 241 00000100:00100000:2.0:1788843252.647973:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843252.648673:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775808896 00000100:00100000:3.0:1788843252.648686:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775808896 00000100:00100000:3.0:1788843252.648758:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 300 00000100:00100000:3.0:1788843252.648769:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab48999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+7:2355:x1875737775808896:12345-192.168.203.29@tcp:251:umount.0 00000020:00000080:3.0:1788843252.648826:0:5841:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914c60 00000020:00010000:3.0:1788843252.648837:0:5841:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dab77ab6000: total 0 00000100:00080000:3.0:1788843252.648852:0:5841:0:(import.c:65:import_set_state_nolock()) ffff8dab77ab1000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788843252.648941:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab48999450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48+3:2355:x1875737775808896:12345-192.168.203.29@tcp:251:umount.0 Request processed in 174us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843252.648949:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 300 00000020:00010000:2.0:1788843252.649056:0:7639:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dab77ab6000: total 0 00010000:00010000:2.0:1788843252.649061:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843252.649111:0:7639:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dab77ab6000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788843252.649162:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab40030a00/0xc6b8ac1b0914cb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084784 expref: 2 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843252.649180:0:7639:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dab77ab6000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1788843252.649190:0:7639:0:(genops.c:885:class_export_put()) final put ffff8dab77ab6000/09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48 00010000:00010000:2.0:1788843252.649209:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843252.649212:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843252.649214:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788843252.649584:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab77ab6000/09b9dc4a-4972-4eb6-8d96-03fa3ef6fe48 for MGS 00000020:00000080:0.0:1788843252.649627:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab77ab1000 for MGS 00010000:00010000:2.0:1788843253.514659:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843254.532908:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788843254.575837:0:13020:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788843254.598555:0:13020:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788843254.598620:0:13020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88800/0xc6b8ac1b0914cf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.598635:0:13020:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88800/0xc6b8ac1b0914cf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914cfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.598644:0:13020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88800/0xc6b8ac1b0914cf3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914cfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.598652:0:13020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88800/0xc6b8ac1b0914cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914cfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.598676:0:13020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788843254.598682:0:13020:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788843254.598703:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788843254.598721:0:13020:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788843254.598740:0:13020:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788843254.598765:0:13020:0:(import.c:65:import_set_state_nolock()) ffff8dab4415c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788843254.598830:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843254.598840:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88800/0xc6b8ac1b0914cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914cfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843254.598847:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88800 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843254.598850:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88800/0xc6b8ac1b0914cf3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914cfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843254.598859:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88800/0xc6b8ac1b0914cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0914cfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843254.598867:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88800/0xc6b8ac1b0914cf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0914cfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843254.598872:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788843254.598875:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788843254.598878:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788843254.598910:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88800/0xc6b8ac1b0914cf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0914cfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843254.598917:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843254.598947:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88800/0xc6b8ac1b0914cf3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0914cfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843254.598954:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88800/0xc6b8ac1b0914cf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0914cfa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843254.598965:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843254.598967:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843254.598969:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843254.598988:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788843254.599008:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795708800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843254.599080:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843254.599145:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795708800 00000100:00100000:3.0:1788843254.599152:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795708800 00000100:00100000:3.0:1788843254.599207:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788843254.599217:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab4886ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+19:3304:x1875737795708800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843254.599230:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843254.599245:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab40030200/0xc6b8ac1b0914cfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0914cf3 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843254.599258:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843254.599315:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab4886ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:28cf63da-daee-485f-b466-4ec68876f732+18:3304:x1875737795708800:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843254.599323:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788843254.599337:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875737795708672:0@lo:39:umount.0 00000100:00100000:1.0:1788843254.599388:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843254.599423:0:7168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795708672 00000100:00100000:1.0:1788843254.599427:0:7168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795708672 00000100:00100000:1.0:1788843254.599456:0:7168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1788843254.599469:0:7168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875737795708672:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788843254.599491:0:7168:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914a6f 00000100:00080000:1.0:1788843254.599499:0:7168:0:(import.c:65:import_set_state_nolock()) ffff8dab4375d800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788843254.599544:0:7168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3303:x1875737795708672:12345-0@lo:39:umount.0 Request processed in 76us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843254.599560:0:7168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1788843254.599567:0:7168:0:(genops.c:885:class_export_put()) final put ffff8dab4375b000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1788843254.599588:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788843254.599611:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab4415c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788843254.599620:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875737795708672:0@lo:39:umount.0 00000020:00000080:3.0:1788843254.600128:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab4375b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788843254.600183:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab4375d800 for lustre-MDT0000 00000100:00080000:0.0:1788843254.600445:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788843254.600449:0:13020:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788843254.600455:0:13020:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788843254.601445:0:13020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89400/0xc6b8ac1b0914d01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914d08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.601461:0:13020:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89400/0xc6b8ac1b0914d01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914d08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.601470:0:13020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89400/0xc6b8ac1b0914d01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914d08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.601478:0:13020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89400/0xc6b8ac1b0914d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914d08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.601497:0:13020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843254.601503:0:13020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0914c1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914c21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.601510:0:13020:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0914c1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914c21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.601518:0:13020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0914c1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914c21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.601525:0:13020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0914c1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914c21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.601558:0:13020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788843254.601575:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843254.601582:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89400/0xc6b8ac1b0914d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914d08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.601589:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff89400 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843254.601594:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89400/0xc6b8ac1b0914d01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914d08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.601603:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89400/0xc6b8ac1b0914d01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0914d08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843254.601612:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89400/0xc6b8ac1b0914d01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0914d08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843254.601619:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788843254.601622:0:7637:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788843254.601656:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89400/0xc6b8ac1b0914d01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0914d08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.601663:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843254.601687:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89400/0xc6b8ac1b0914d01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0914d08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.601694:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab7ff89400/0xc6b8ac1b0914d01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0914d08 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.601709:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843254.601713:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0914c1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914c21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.601736:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5600 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843254.601740:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0914c1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914c21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.601748:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0914c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0914c21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843254.601754:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0914c1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0914c21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843254.601760:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788843254.601763:0:7637:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788843254.601766:0:7637:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788843254.601781:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0914c1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0914c21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.601788:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843254.601794:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0914c1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0914c21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.601802:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0914c1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0914c21 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.601819:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843254.601820:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843254.601822:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843254.601844:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795709056:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843254.601927:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843254.601972:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843254.601985:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795708928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843254.602007:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843254.602036:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795709056 00000100:00100000:0.0:1788843254.602043:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795709056 00000100:00100000:0.0:1788843254.602084:0:6708:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795708928 00000100:00100000:0.0:1788843254.602087:0:6708:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795708928 00000100:00100000:0.0:1788843254.602106:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788843254.602113:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28cf63da-daee-485f-b466-4ec68876f732+19:3307:x1875737795709056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843254.602126:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843254.602142:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab40030800/0xc6b8ac1b0914c21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0914c1a expref: 19 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602157:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843254.602186:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28cf63da-daee-485f-b466-4ec68876f732+18:3307:x1875737795709056:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843254.602193:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788843254.602208:0:6708:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843254.602213:0:6708:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28cf63da-daee-485f-b466-4ec68876f732+17:3307:x1875737795708928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843254.602220:0:6708:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843254.602228:0:6708:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab40031600/0xc6b8ac1b0914d08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0914d01 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602236:0:6708:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843254.602255:0:6708:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:28cf63da-daee-485f-b466-4ec68876f732+16:3307:x1875737795708928:12345-0@lo:103:ldlm_bl.0 Request processed in 41us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843254.602261:0:6708:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843254.602288:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795708928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843254.602297:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:28cf63da-daee-485f-b466-4ec68876f732:3307:1875737795709056:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843254.602327:0:13020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914f1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914f23 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602336:0:13020:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914f1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914f23 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602379:0:13020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914f1c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914f23 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602387:0:13020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914f1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914f23 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602399:0:13020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843254.602404:0:13020:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab82054600/0xc6b8ac1b09149ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09149d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602411:0:13020:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab82054600/0xc6b8ac1b09149ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b09149d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602417:0:13020:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab82054600/0xc6b8ac1b09149ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b09149d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602423:0:13020:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab82054600/0xc6b8ac1b09149ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b09149d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602433:0:13020:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788843254.602436:0:13020:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788843254.602439:0:13020:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788843254.602462:0:13020:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788843254.602466:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788843254.602474:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843254.602479:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:0.0:1788843254.602484:0:13020:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dab7fcf2000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788843254.602490:0:13020:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8dab7b95c000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788843254.602497:0:13020:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8dab77a7d800 b6d1c4e8-7f8e-438b-8c74-80bf75c52b59 192.168.203.29@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788843254.602502:0:13020:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8dab7c18f000 fb38c5ab-0241-4970-81c2-7e93fb808128 192.168.203.29@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967521 stale:0 00000020:00080000:0.0:1788843254.602507:0:13020:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8dab5141cd28) has exports, disconnecting them 00000020:00080000:0.0:1788843254.602512:0:13020:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dab7fcf2000), last request at 1788843252 00000020:00000080:0.0:1788843254.602518:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914be2 00000100:00080000:0.0:1788843254.602533:0:13020:0:(import.c:65:import_set_state_nolock()) ffff8dab73d8c000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788843254.602564:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843254.602569:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914f1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914f23 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602575:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88400 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843254.602578:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914f1c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914f23 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602585:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914f1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0914f23 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843254.602591:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914f1c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0914f23 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843254.602597:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788843254.602599:0:7637:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788843254.602601:0:7637:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788843254.602614:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914f1c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0914f23 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602625:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843254.602638:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914f1c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0914f23 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602645:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab7ff88400/0xc6b8ac1b0914f1c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0914f23 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602654:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843254.602658:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab82054600/0xc6b8ac1b09149ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b09149d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602664:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054600 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843254.602667:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab82054600/0xc6b8ac1b09149ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b09149d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602674:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab82054600/0xc6b8ac1b09149ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b09149d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843254.602681:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab82054600/0xc6b8ac1b09149ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b09149d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843254.602686:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788843254.602688:0:7637:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788843254.602690:0:7637:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788843254.602700:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab82054600/0xc6b8ac1b09149ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b09149d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602706:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843254.602711:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab82054600/0xc6b8ac1b09149ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b09149d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602737:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab82054600/0xc6b8ac1b09149ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b09149d5 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602751:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843254.602752:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843254.602754:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843254.602765:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795709312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843254.602791:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843254.602815:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843254.602820:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795709184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843254.602836:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843254.602856:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795709312 00000100:00100000:0.0:1788843254.602860:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795709312 00000100:00100000:0.0:1788843254.602877:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795709184 00000100:00100000:0.0:1788843254.602879:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795709184 00000100:00100000:0.0:1788843254.602891:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788843254.602897:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+17:3305:x1875737795709312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843254.602905:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843254.602914:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab41533400/0xc6b8ac1b09149d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b09149ce expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.602925:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843254.602950:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+16:3305:x1875737795709312:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843254.602957:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788843254.602968:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788843254.602974:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c0a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+15:3305:x1875737795709184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843254.602992:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843254.603001:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab41533600/0xc6b8ac1b0914f23 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0914f1c expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843254.603010:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843254.603032:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c0a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:28cf63da-daee-485f-b466-4ec68876f732+14:3305:x1875737795709184:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843254.603039:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788843254.603048:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843254.603074:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795709184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843254.603087:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795709312:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1788843254.603113:0:13020:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dab7fcf2000): rc 0 00000020:00000080:0.0:1788843254.603116:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab7fcf2000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788843254.603139:0:13020:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dab7b95c000), last request at 1788843252 00000020:00000080:0.0:1788843254.603144:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914b17 00000100:00080000:0.0:1788843254.603151:0:13020:0:(import.c:65:import_set_state_nolock()) ffff8dab7b958800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788843254.603164:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788843254.603171:0:13020:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dab7b95c000): rc 0 00000020:00000080:0.0:1788843254.603173:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab7b95c000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788843254.603180:0:13020:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa9b2c1463ae0 00000100:00080000:0.0:1788843254.603199:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788843254.603202:0:13020:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:0.0:1788843254.603214:0:13020:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788843254.603273:0:13020:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788843254.603286:0:13020:0:(import.c:65:import_set_state_nolock()) ffff8dab73d8c800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788843254.603297:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788843254.603299:0:13020:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788843254.603305:0:13020:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788843254.603390:0:13020:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788843254.603400:0:13020:0:(import.c:65:import_set_state_nolock()) ffff8dab7c189000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788843254.603428:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8dab5141cd28) has no exports 00000020:00000080:1.0:1788843254.603505:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7fcf2000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788843254.603547:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7b95c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788843254.603566:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab73d8c000 for lustre-MDT0000 00000020:00000080:1.0:1788843254.603571:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab7b958800 for lustre-MDT0000 00010000:00010000:1.0:1788843254.603587:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843254.603597:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795709440:0@lo:9:umount.0 00000100:00100000:1.0:1788843254.603635:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843254.603667:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795709568:0@lo:9:umount.0 00000100:00100000:1.0:1788843254.603687:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843254.603719:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795709440 00000100:00100000:1.0:1788843254.603725:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795709440 00000100:00100000:1.0:1788843254.603775:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795709568 00000100:00100000:1.0:1788843254.603778:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795709568 00000100:00100000:1.0:1788843254.603799:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788843254.603807:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875737795709440:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788843254.603827:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914b64 00000100:00080000:1.0:1788843254.603834:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8dab4416d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788843254.603862:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1788843254.604032:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3303:x1875737795709440:12345-0@lo:9:umount.0 Request processed in 225us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843254.604039:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788843254.604062:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788843254.604068:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1875737795709568:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788843254.604080:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914c52 00000100:00080000:1.0:1788843254.604085:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8dab7c18f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788843254.604106:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788843254.604442:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3303:x1875737795709568:12345-0@lo:9:umount.0 Request processed in 373us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843254.604449:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788843254.604468:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788843254.604472:0:5843:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788843254.604486:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843254.604491:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788843254.604520:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab73d8c800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788843254.604533:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788843254.604535:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788843254.604540:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795709440:0@lo:9:umount.0 00000100:00080000:1.0:1788843254.604552:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab7c189000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788843254.604558:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788843254.604560:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788843254.604563:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795709568:0@lo:9:umount.0 00010000:00010000:2.0:1788843254.604768:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843254.604894:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:28cf63da-daee-485f-b466-4ec68876f732:3304:1875737795708800:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1788843254.612772:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8dab5141cd28) has no exports 00000020:00000080:1.0:1788843254.668077:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914a29 00000020:00000080:1.0:1788843254.668098:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab440c6800/lustre-QMT0000_UUID 00000020:01000000:1.0:1788843254.668164:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788843254.668279:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843254.668301:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788843254.668306:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8dab477d99b8) has no exports 00000020:00000080:3.0:1788843254.668786:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab440c6800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788843254.668982:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914a22 00000020:00000080:0.0:1788843254.668990:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab7cd16800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788843254.669101:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7cd16800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788843254.669193:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843254.669203:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788843254.669206:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab6da24800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788843254.669209:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab6da24800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788843254.669218:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:1.0:1788843255.556528:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788843256.178615:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fb38c5ab-0241-4970-81c2-7e93fb808128 00000001:00080000:2.0:1788843256.178635:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000001:00100000:2.0:1788843256.178654:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b6d1c4e8-7f8e-438b-8c74-80bf75c52b59 00000001:00080000:2.0:1788843256.178658:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1788843256.178662:0:5868:0:(genops.c:885:class_export_put()) final put ffff8dab77a7d800/b6d1c4e8-7f8e-438b-8c74-80bf75c52b59 00000020:00000080:2.0:1788843256.178681:0:5868:0:(genops.c:885:class_export_put()) final put ffff8dab7c18f000/fb38c5ab-0241-4970-81c2-7e93fb808128 00000020:00000080:2.0:1788843256.178699:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab77a7d800/b6d1c4e8-7f8e-438b-8c74-80bf75c52b59 for lustre-MDT0000 00000020:00000080:2.0:1788843256.181247:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7c18f000/fb38c5ab-0241-4970-81c2-7e93fb808128 for lustre-MDT0000 00000020:00000080:2.0:1788843256.181285:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab77a7b800 for lustre-MDT0000 00000020:00000080:2.0:1788843256.181290:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab7c18d800 for lustre-MDT0000 00000001:00100000:0.0:1788843256.225811:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788843256.225822:0:6719:0:(genops.c:885:class_export_put()) final put ffff8dab4416c000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788843256.225852:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fb38c5ab-0241-4970-81c2-7e93fb808128 00000020:00000080:0.0:1788843256.225855:0:6719:0:(genops.c:885:class_export_put()) final put ffff8dab60259800/fb38c5ab-0241-4970-81c2-7e93fb808128 00000020:00000080:2.0:1788843256.226020:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab4416c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788843256.226078:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab60259800/fb38c5ab-0241-4970-81c2-7e93fb808128 for lustre-OST0000 00000020:00000080:2.0:1788843256.226102:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab4416d000 for lustre-OST0000 00000020:00000080:2.0:1788843256.226107:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab6025f000 for lustre-OST0000 00010000:00010000:1.0:1788843256.581148:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788843256.709179:0:13020:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dab7ff4b060 - data ffff8dab66e311b0/ffff8dab7c05f000 00000020:01000000:0.0:1788843256.709489:0:13020:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dab50f73420 - data ffff8dab5f5b21b0/ffff8dab48930800 00000001:00000004:0.0:1788843256.718903:0:13020:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:1.0:1788843256.787416:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788843256.787432:0:13020:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1788843256.787463:0:13020:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788843256.787484:0:13020:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788843256.788665:0:6964:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788843256.788674:0:6964:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1788843256.788685:0:6964:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788843256.790509:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788843256.790521:0:13020:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1788843256.790580:0:13020:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788843256.790584:0:13020:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788843256.790856:0:8098:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788843256.790864:0:8098:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1788843256.790881:0:8098:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788843256.847734:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b09149f1 00000020:00000080:2.0:1788843256.847750:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab6ec53000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788843256.848463:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab6ec53000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788843256.849534:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914a06 00000020:00000080:2.0:1788843256.849555:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab6ec56000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788843256.849573:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788843256.849578:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843256.849588:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788843256.849592:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8dab5141b370) has no exports 00000020:00000080:1.0:1788843256.849645:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab6ec56000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1788843256.850259:0:13020:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788843256.850272:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914c44 00000020:00000080:2.0:1788843256.850277:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab73d88800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788843256.850288:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788843256.850293:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843256.850301:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788843256.850304:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8dab477dcd28) has no exports 00000020:00000080:1.0:1788843256.850307:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab73d88800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788843256.850312:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914c3d 00000020:00000080:2.0:1788843256.850318:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab7c188000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788843256.850371:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7c188000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788843256.850837:0:13020:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788843256.850844:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788843256.850851:0:13020:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1788843256.850859:0:13020:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788843256.850862:0:13020:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788843256.850905:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab7c189000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788843256.851227:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843256.851238:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788843256.851243:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab48812800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788843256.851246:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab48812800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788843256.851252:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788843256.851384:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914b5d 00000020:00000080:2.0:1788843256.851391:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab77a7c000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788843256.851400:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788843256.851405:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843256.851410:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:1.0:1788843256.851413:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab77a7c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00080000:2.0:1788843256.851414:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8dab7ffd8000) has no exports 00000020:00000080:2.0:1788843256.851422:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914b56 00000020:00000080:2.0:1788843256.851426:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab7d99e800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788843256.851452:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7d99e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788843256.851987:0:13020:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788843256.851991:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788843256.851995:0:13020:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1788843256.851999:0:13020:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788843256.852001:0:13020:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788843256.852043:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843256.852048:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788843256.852083:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843256.852087:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788843256.852090:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab6e2c7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788843256.852093:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab6e2c7000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788843256.852100:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788843256.852110:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab73d8c800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788843256.852133:0:36:0:(genops.c:885:class_export_put()) final put ffff8dab7fcb7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788843256.852136:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7fcb7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1788843256.852145:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788843256.852244:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914a0d 00000020:00000080:2.0:1788843256.852249:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab6ec51000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788843256.852262:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788843256.852265:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843256.852269:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788843256.852272:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8dab51418000) has no exports 00000020:00000080:2.0:1788843256.852292:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843256.852295:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788843256.852299:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914a14 00000020:00000080:2.0:1788843256.852302:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab6ec50000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788843256.852308:0:13020:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dab71a20000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788843256.852311:0:13020:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab71a20000 3 00000020:01000004:2.0:1788843256.852314:0:13020:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dab71a20000 from lustre-MDT0000 00000020:00000080:2.0:1788843256.852333:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843256.852337:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788843256.852360:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab6ec57800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788843256.852363:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab6ec57800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788843256.852370:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788843256.852408:0:13020:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788843256.852412:0:13020:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788843256.852421:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788843256.852425:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843256.852428:0:13020:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788843256.852435:0:13020:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8dab51578800 28cf63da-daee-485f-b466-4ec68876f732 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788843256.852440:0:13020:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8dab514199b8) has exports, disconnecting them 00000020:00080000:2.0:1788843256.852445:0:13020:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8dab51578800), last request at 1788843031 00000020:00000080:2.0:1788843256.852460:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b09149b2 00000020:00010000:2.0:1788843256.852465:0:13020:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8dab51578800: total 2 00000100:00080000:2.0:1788843256.852469:0:13020:0:(import.c:65:import_set_state_nolock()) ffff8dab5157c000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788843256.852486:0:13020:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dab51578800): rc 0 00000020:00080000:2.0:1788843256.852490:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8dab514199b8) has no exports 00000020:00000080:1.0:1788843256.852495:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab6ec51000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788843256.852501:0:36:0:(genops.c:885:class_export_put()) final put ffff8dab6ec54000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788843256.852504:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab6ec54000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788843256.852510:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00010000:3.0:1788843256.852564:0:5834:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8dab51578800: total 2 00010000:00010000:3.0:1788843256.852616:0:5834:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dab51578800, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788843256.852647:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab4933ba00/0xc6b8ac1b0914f07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0914f00 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843256.852670:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab40031e00/0xc6b8ac1b0914aca lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0914ac3 expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843256.852690:0:5839:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8dab60021c00:5839] 0 exiting: rc = 1 00010000:00010000:3.0:1788843256.852695:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7ff89600/0xc6b8ac1b0914d16 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0914d0f expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788843256.852696:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab6ec50000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788843256.852726:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0914f15 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0914f0e expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843256.852743:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab40031c00/0xc6b8ac1b0914cc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0914cbb expref: 5 pid: 5841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843256.852758:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab41533200/0xc6b8ac1b0914cd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0914cc9 expref: 4 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843256.852773:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab40030400/0xc6b8ac1b0914cde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0914cd7 expref: 3 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843256.852786:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7ff89a00/0xc6b8ac1b0914cec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xc6b8ac1b0914ce5 expref: 2 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843256.852803:0:5834:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dab51578800, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788843256.852828:0:5834:0:(genops.c:885:class_export_put()) final put ffff8dab51578800/28cf63da-daee-485f-b466-4ec68876f732 00000100:00100000:2.0:1788843256.852834:0:5840:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8dab69817600:5840] 1 exiting: rc = 0 00010000:00010000:3.0:1788843256.852843:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843256.852846:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843256.852849:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788843256.852865:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab51578800/28cf63da-daee-485f-b466-4ec68876f732 for MGS 00000100:00100000:3.0:1788843256.852895:0:5841:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8dab69816000:5841] 2 exiting: rc = 0 00000020:00000080:1.0:1788843256.852896:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab5157c000 for MGS 00000100:00100000:2.0:1788843256.853000:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853009:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853015:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853022:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853029:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853038:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853046:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853054:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853062:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853071:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853077:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853089:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853096:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853102:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853107:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853113:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853119:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853127:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853133:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853142:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853156:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853163:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853171:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853178:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853185:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853191:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853197:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853202:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853208:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853213:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853219:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853224:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853229:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853234:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853239:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853245:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853250:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853255:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853264:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853272:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853279:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853286:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853293:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853300:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853307:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853314:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853321:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853328:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853336:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853364:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853372:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853378:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853385:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853392:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853397:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853411:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853420:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853426:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853434:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853443:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853451:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853460:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853470:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.853480:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1788843256.854599:0:13020:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788843256.854604:0:13020:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:3.0:1788843256.855110:0:13020:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dab442ce780 - data ffff8dab66eef0d8/ffff8dab488aa800 00000020:01000000:3.0:1788843256.855282:0:13020:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dab43333ba0 - data ffff8dab5f7e4288/ffff8dab489ed800 00000020:00000080:3.0:1788843256.856249:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914996 00000020:00000080:3.0:1788843256.856261:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab699d6800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788843256.856292:0:13020:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dab71a20000 from MGS, refs=2 00000020:01000004:3.0:1788843256.856296:0:13020:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab71a20000 2 00000020:01000004:3.0:1788843256.856300:0:13020:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dab71a20000 from MGS 00000020:00000080:3.0:1788843256.856325:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788843256.856332:0:13020:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788843256.856335:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab699d7000/MGS 00000020:00000080:3.0:1788843256.856358:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab699d7000/MGS for MGS 00000020:01000000:3.0:1788843256.856368:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:00000080:1.0:1788843256.856478:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab699d6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1788843256.856529:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788843256.856534:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843256.856541:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788843256.856548:0:13020:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8dab441ce000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788843256.856554:0:13020:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8dab440e99b8) has exports, disconnecting them 00000020:00080000:3.0:1788843256.856560:0:13020:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8dab441ce000), last request at 1788843032 00000020:00000080:3.0:1788843256.856565:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914a61 00000020:00080000:3.0:1788843256.856578:0:13020:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dab441ce000): rc 0 00000020:00000080:3.0:1788843256.856583:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab441ce000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788843256.857395:0:13020:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788843256.857402:0:13020:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788843256.857406:0:13020:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788843256.857412:0:13020:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788843256.857763:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab441ce000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1788843256.858072:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab4415c000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788843256.858208:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843256.858221:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788843256.858227:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab4415b000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788843256.858230:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab4415b000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788843256.858238:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788843256.858323:0:13020:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab71a20000 1 00000020:00000080:2.0:1788843256.858329:0:13020:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914988 00000020:00000080:2.0:1788843256.858336:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab699d5000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788843256.858379:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1788843256.858382:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab699d5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788843256.858408:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843256.858413:0:13020:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788843256.858417:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8dab440e8000) has no exports 00000020:00000080:2.0:1788843256.890632:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843256.890652:0:13020:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788843256.890658:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab71a22800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788843256.890663:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab71a22800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788843256.890671:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788843256.890812:0:13020:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dab71a25800 00000020:01000000:2.0:1788843256.890834:0:13020:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788843256.890848:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843256.890854:0:13020:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788843256.890858:0:13020:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8dab60073370) has no exports 00000100:00100000:3.0:1788843256.891056:0:5847:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8dab600b8400:5847] 1 exiting: rc = 0 00000100:00100000:0.0:1788843256.891212:0:5846:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8dab58cb3e00:5846] 0 exiting: rc = 1 00000100:00100000:0.0:1788843256.891487:0:7168:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8dab7bb0da00:7168] 3 exiting: rc = 0 00000100:00100000:2.0:1788843256.893610:0:5848:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8dab600b9600:5848] 2 exiting: rc = 0 00000100:00100000:0.0:1788843256.893755:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893766:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893773:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893779:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893785:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893791:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893796:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893802:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893807:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893829:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893835:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893841:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893846:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893852:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893857:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893863:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893869:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893877:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893884:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893890:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893895:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893901:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893907:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893913:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893919:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893924:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893929:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893934:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893939:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893945:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893951:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893956:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893962:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893969:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893974:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893981:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893986:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893992:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.893999:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894004:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894009:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894015:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894020:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894025:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894039:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894045:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894050:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894055:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894061:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894067:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894072:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894077:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894083:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894089:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894094:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894099:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894105:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894111:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894117:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894123:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894129:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894135:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894140:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.894147:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.899204:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8dab6003e600:5849] 0 exiting: rc = 1 00000100:00100000:1.0:1788843256.899262:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8dab58cb3a00:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1788843256.899515:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899523:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899530:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899537:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899543:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899549:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899555:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899563:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899569:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899575:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899581:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899587:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899593:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899598:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899604:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899610:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899615:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899621:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899626:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899631:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899635:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899641:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899646:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899652:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899657:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899663:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899668:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899673:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899678:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899684:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899690:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899695:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899701:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899706:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899721:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899736:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899741:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899748:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899754:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899759:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899764:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899769:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899775:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899781:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899786:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899791:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899796:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899801:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899806:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899811:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899816:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899821:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899826:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899831:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899835:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899841:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899846:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899850:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899855:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899859:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899864:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899869:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899874:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.899878:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.900422:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8dab60023800:5852] 1 exiting: rc = 0 00000100:00100000:2.0:1788843256.900587:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8dab4364c800:5851] 0 exiting: rc = 1 00000100:00100000:1.0:1788843256.900840:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900850:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900860:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900871:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900877:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900882:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900900:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900907:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900913:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900919:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900926:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900943:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900950:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900955:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900962:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900968:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900974:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900979:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900986:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900991:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.900997:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901002:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901009:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901026:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901033:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901039:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901045:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901051:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901057:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901064:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901070:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901077:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901083:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901089:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901096:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901116:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901123:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901129:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901137:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901145:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901152:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901169:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901176:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901189:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901195:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901201:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901208:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901232:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901240:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901246:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901252:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901260:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901265:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901271:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901277:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901285:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901292:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901299:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901305:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901326:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901333:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901533:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901543:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843256.901551:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.908537:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8dab489db000:5853] 0 exiting: rc = 1 00000100:00100000:1.0:1788843256.908652:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8dab60022a00:5854] 1 exiting: rc = 0 00000100:00100000:3.0:1788843256.908779:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908786:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908792:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908798:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908805:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908836:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908842:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908849:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908855:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908861:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908867:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908874:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908880:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908886:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908892:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908898:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908904:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908909:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908915:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908920:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908926:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908932:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908938:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908944:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908949:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908955:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908960:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908966:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908971:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908976:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908982:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908988:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908993:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.908999:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909007:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909012:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909019:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909025:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909031:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909037:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909050:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909055:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909060:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909065:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909069:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909074:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909080:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909084:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909089:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909095:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909100:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909105:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909109:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909113:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909119:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909124:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909130:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909135:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909141:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909147:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909152:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909156:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909161:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.909166:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.909929:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8dab60022800:5856] 1 exiting: rc = 0 00000100:00100000:1.0:1788843256.910059:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8dab60023200:5855] 0 exiting: rc = 1 00000100:00100000:3.0:1788843256.910162:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910169:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910175:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910180:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910184:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910189:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910194:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910199:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910208:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910214:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910219:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910235:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910241:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910246:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910252:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910258:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910263:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910268:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910274:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910278:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910283:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910288:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910293:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910298:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910304:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910309:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910315:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910319:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910324:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910328:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910333:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910337:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910517:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910523:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910528:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910533:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910538:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910544:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910549:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910555:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910560:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910565:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910570:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910575:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910580:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910585:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910598:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910603:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910609:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910615:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910620:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910625:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910630:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910635:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910640:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910646:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910650:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910655:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910660:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910665:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910670:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910676:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910682:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.910687:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.911127:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8dab600f5000:5858] 1 exiting: rc = 0 00000100:00100000:0.0:1788843256.911133:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8dab600f2600:5857] 0 exiting: rc = 1 00000100:00100000:3.0:1788843256.914850:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.914867:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.914873:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.914878:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.914883:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.914887:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.914892:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.914898:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.914903:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916719:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916749:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916754:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916762:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916767:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916772:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916776:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916780:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916803:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916807:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916810:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916814:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916817:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916821:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916824:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916827:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916830:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916834:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916837:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916840:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916843:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916846:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916850:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916852:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916855:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916858:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916861:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916865:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916868:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916871:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916874:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916877:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916880:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916884:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916887:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916890:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916893:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916896:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916899:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916902:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916904:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916907:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916920:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916927:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916930:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916933:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916936:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916940:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916943:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916946:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916949:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916952:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916955:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916958:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843256.916961:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843256.919935:0:5859:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8dab50466800:5859] 0 exiting: rc = 1 00000100:00100000:0.0:1788843256.921381:0:5860:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8dab50467c00:5860] 1 exiting: rc = 0 00000100:00100000:3.0:1788843256.922161:0:5861:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8dab50467800:5861] 2 exiting: rc = 0 00000100:00100000:0.0:1788843256.922300:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922310:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922316:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922322:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922328:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922334:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922511:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922521:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922527:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922533:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922540:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922546:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922552:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922574:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922580:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922587:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922593:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922599:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922604:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922610:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922616:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922622:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922632:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922655:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922662:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922667:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922673:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922679:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922685:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922691:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922698:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922705:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922720:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922727:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922733:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922739:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922746:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922753:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922759:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922767:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922778:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922785:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922792:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922798:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922804:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922811:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922818:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922839:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922852:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922858:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922865:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922871:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922877:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922883:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922889:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922895:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.922900:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.923103:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.923114:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.923121:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.923127:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.923137:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.923144:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843256.923152:0:13020:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788843256.930225:0:13020:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788843256.930240:0:13020:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788843256.930246:0:13020:0:(genops.c:885:class_export_put()) final put ffff8dab4375e800/MDS_uuid 00000020:00000080:1.0:1788843256.930250:0:13020:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab4375e800/MDS_uuid for MDS 00000020:01000000:1.0:1788843256.930261:0:13020:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788843256.930533:0:13020:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:3.0:1788843257.159213:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795709696:0@lo:400:kworker.0 00000400:00000100:3.0:1788843257.159314:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875737795709696 offset 0 length 224: 4 00000100:00100000:3.0:1788843257.159426:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843257.159433:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795709824:0@lo:400:kworker.0 00000400:00000100:3.0:1788843257.159458:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875737795709824 offset 0 length 224: 4 00000100:00100000:3.0:1788843257.159486:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795709952:0@lo:400:kworker.0 00000400:00000100:3.0:1788843257.159507:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875737795709952 offset 0 length 224: 4 00000001:00100000:3.0:1788843257.257945:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788843257.257956:0:7650:0:(genops.c:885:class_export_put()) final put ffff8dab7c18e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788843257.258028:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7c18e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788843257.258096:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab7c18f800 for lustre-OST0001 00010000:00010000:3.0:1788843257.607484:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843258.628549:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843259.656742:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788843260.393580:0:13175:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788843260.409891:0:13175:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:2.0:1788843260.409957:0:13175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41533e00/0xc6b8ac1b0914cd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cde expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843260.409975:0:13175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41533e00/0xc6b8ac1b0914cd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914cde expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843260.409983:0:13175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41533e00/0xc6b8ac1b0914cd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914cde expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843260.409990:0:13175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab41533e00/0xc6b8ac1b0914cd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914cde expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843260.410022:0:13175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788843260.410027:0:13175:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788843260.410068:0:13175:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788843260.410083:0:13175:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dab7c182680 x1875737795709824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843273 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843260.410138:0:13175:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788843260.410146:0:13175:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788843260.410188:0:13175:0:(import.c:65:import_set_state_nolock()) ffff8dab7d99d000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788843260.410375:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843260.410385:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab41533e00/0xc6b8ac1b0914cd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914cde expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843260.410394:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41533e00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843260.410398:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab41533e00/0xc6b8ac1b0914cd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914cde expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843260.410415:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab41533e00/0xc6b8ac1b0914cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0914cde expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843260.410423:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab41533e00/0xc6b8ac1b0914cd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0914cde expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843260.410428:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788843260.410430:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788843260.410432:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788843260.410460:0:5834:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab41533e00/0xc6b8ac1b0914cd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0914cde expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843260.410466:0:5834:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788843260.410522:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795710208:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843260.410617:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843260.410635:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795709824:0@lo:400:kworker.0 00000100:00100000:0.0:1788843260.410668:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795710208 00000100:00100000:0.0:1788843260.410674:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795710208 00010000:00010000:3.0:1788843260.410705:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab41533e00/0xc6b8ac1b0914cd7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0914cde expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843260.410713:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab41533e00/0xc6b8ac1b0914cd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xc6b8ac1b0914cde expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843260.410727:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875737795710080:0@lo:39:umount.0 00010000:00010000:3.0:1788843260.410728:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843260.410728:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00010000:00010000:3.0:1788843260.410731:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843260.410735:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843260.410738:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3305:x1875737795710208:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788843260.410751:0:5831:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788843260 with bad export cookie 894961515458808242 00000400:00000100:1.0:1788843260.410774:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875737795710080 offset 0 length 224: 4 00000100:00100000:0.0:1788843260.426064:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3305:x1875737795710208:12345-0@lo:103:ldlm_bl.0 Request processed in 15317us (15438us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788843260.426077:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788843260.426307:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.129@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788843260.426312:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8dab43758000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788843260.426316:0:3305:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.129@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1788843260.433315:0:3305:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.129@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788843260.433320:0:3305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788843260.433330:0:3305:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dab7c181880 x1875737795709696/t0(0) o400->MGC192.168.203.129@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788843273 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843260.433526:0:3305:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dab7c183100 x1875737795710208/t0(0) o103->MGC192.168.203.129@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788843276 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788843260.433537:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788843260.433540:0:3305:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788843260.433542:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788843260.433548:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8dab43758000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843260.433554:0:3305:0:(import.c:510:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 155 00000100:00080000:2.0:1788843260.433565:0:3305:0:(import.c:624:import_select_connection()) MGC192.168.203.129@tcp: import ffff8dab43758000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1788843260.433599:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:28cf63da-daee-485f-b466-4ec68876f732:3306:1875737795709696:0@lo:400:kworker.0 00000100:00100000:3.0:1788843260.433715:0:3305:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab7c181f80 x1875737795710336/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788843260.433756:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:28cf63da-daee-485f-b466-4ec68876f732:3305:1875737795710208:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843260.433812:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:28cf63da-daee-485f-b466-4ec68876f732:3303:1875737795710336:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1788843260.433869:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875737795710336 offset 0 length 520: 4 00010000:00010000:3.0:1788843260.676657:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843261.700492:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788843262.277591:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 28cf63da-daee-485f-b466-4ec68876f732->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788843262.277608:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 28cf63da-daee-485f-b466-4ec68876f732->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788843262.277720:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795710464:0@lo:400:kworker.0 00000400:00000100:0.0:1788843262.277808:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875737795710464 offset 0 length 224: 4 00010000:00010000:1.0:1788843262.725383:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843263.748673:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843264.772946:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788843265.285198:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 28cf63da-daee-485f-b466-4ec68876f732->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788843265.285229:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 28cf63da-daee-485f-b466-4ec68876f732->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788843265.285485:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843265.285507:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795710592:0@lo:400:kworker.0 00000400:00000100:1.0:1788843265.285591:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875737795710592 offset 0 length 224: 4 00010000:00010000:1.0:1788843265.796588:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843266.820543:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843267.844517:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843268.868580:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843269.898464:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788843270.468944:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 28cf63da-daee-485f-b466-4ec68876f732->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843270.468954:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 28cf63da-daee-485f-b466-4ec68876f732->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788843270.469089:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795710720:0@lo:400:kworker.0 00000400:00000100:1.0:1788843270.469151:0:3304:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875737795710720 offset 0 length 224: 4 00010000:00010000:1.0:1788843270.916583:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843270.982438:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843260/real 1788843260] req@ffff8dab7c181f80 x1875737795710336/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788843270 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843270.982473:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dab7c181f80 x1875737795710336/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788843270 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843270.982484:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843260/real 1788843260] req@ffff8dab73ffb800 x1875737795710080/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788843270 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843270.982512:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dab73ffb800 x1875737795710080/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788843270 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788843270.982529:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab43758000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843270.982548:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788843270.982552:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:28cf63da-daee-485f-b466-4ec68876f732:3303:1875737795710336:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:2.0:1788843270.982558:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab7d99d000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788843270.982577:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875737795710080:0@lo:39:umount.0 00000100:00080000:3.0:1788843270.983103:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 28cf63da-daee-485f-b466-4ec68876f732->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788843270.983110:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788843270.983112:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dab43758000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788843270.983117:0:38:0:(import.c:510:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 384 00000100:00080000:3.0:1788843270.983122:0:38:0:(import.c:589:import_select_connection()) MGC192.168.203.129@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788843270.983128:0:38:0:(import.c:624:import_select_connection()) MGC192.168.203.129@tcp: import ffff8dab43758000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1788843270.983157:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab7c182d80 x1875737795710848/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843270.983280:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795710976:0@lo:400:kworker.0 00000400:00000100:2.0:1788843270.983325:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875737795710976 offset 0 length 224: 4 00000100:00100000:2.0:1788843270.983426:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:28cf63da-daee-485f-b466-4ec68876f732:3303:1875737795710848:0@lo:250:kworker.0 00000400:00000100:2.0:1788843270.983442:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875737795710848 offset 0 length 520: 4 00000100:00080000:1.0:1788843270.983919:0:13175:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788843270.983924:0:13175:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788843270.983929:0:13175:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788843270.985038:0:13175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab40031a00/0xc6b8ac1b0914ce5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843270.985054:0:13175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab40031a00/0xc6b8ac1b0914ce5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914cec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843270.985062:0:13175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab40031a00/0xc6b8ac1b0914ce5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914cec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843270.985088:0:13175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab40031a00/0xc6b8ac1b0914ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914cec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843270.985113:0:13175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843270.985122:0:13175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b0914f0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914f15 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843270.985129:0:13175:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b0914f0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914f15 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843270.985134:0:13175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b0914f0e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914f15 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843270.985140:0:13175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b0914f0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914f15 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843270.985160:0:13175:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788843270.985165:0:13175:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788843270.985184:0:13175:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788843270.985188:0:13175:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788843270.985192:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788843270.985197:0:13175:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788843270.985201:0:13175:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8dab477db370) has no exports 00000020:00080000:1.0:1788843270.985224:0:13175:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8dab477db370) has no exports 00010000:00010000:2.0:1788843270.985409:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843270.985433:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab40031a00/0xc6b8ac1b0914ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914cec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843270.985441:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40031a00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:2.0:1788843270.985445:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab40031a00/0xc6b8ac1b0914ce5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914cec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843270.985455:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab40031a00/0xc6b8ac1b0914ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0914cec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843270.985462:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab40031a00/0xc6b8ac1b0914ce5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0914cec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843270.985480:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788843270.985483:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788843270.985485:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788843270.985520:0:5835:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dab43758000 00010000:00010000:2.0:1788843270.985524:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab40031a00/0xc6b8ac1b0914ce5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b0914cec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843270.985531:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab40031a00/0xc6b8ac1b0914ce5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b0914cec expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843270.985547:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843270.985550:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b0914f0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914f15 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843270.985557:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933a600 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:2.0:1788843270.985559:0:5835:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b0914f0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914f15 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843270.985566:0:5835:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b0914f0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0914f15 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788843270.985572:0:5835:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b0914f0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0914f15 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843270.985577:0:5835:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788843270.985579:0:5835:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788843270.985581:0:5835:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788843270.985584:0:5835:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dab43758000 00010000:00010000:2.0:1788843270.985587:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b0914f0e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b0914f15 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843270.985599:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b0914f0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b0914f15 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843270.985608:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843270.985610:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843270.985612:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843270.985814:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788843270.987853:0:13175:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dab43644f00 - data ffff8dab77d10360/ffff8dab4932e000 00000020:01000000:1.0:1788843270.987980:0:13175:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dab514bc9c0 - data ffff8dab66c27948/ffff8dab7fcda000 00100000:10000000:1.0:1788843271.000540:0:13175:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788843271.025203:0:13175:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914ae6 00000020:00000080:2.0:1788843271.025212:0:13175:0:(genops.c:885:class_export_put()) final put ffff8dab7fd09800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788843271.025232:0:13175:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dab7395d800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788843271.025235:0:13175:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab7395d800 2 00000020:01000004:2.0:1788843271.025238:0:13175:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dab7395d800 from lustre-OST0000 00000020:00000080:2.0:1788843271.025260:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788843271.025269:0:13175:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788843271.025271:0:13175:0:(genops.c:885:class_export_put()) final put ffff8dab7fd0f800/lustre-OST0000_UUID 00000020:00000080:2.0:1788843271.025274:0:13175:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7fd0f800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788843271.025281:0:13175:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788843271.025324:0:13175:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788843271.025335:0:13175:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788843271.025363:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788843271.025369:0:13175:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788843271.025375:0:13175:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8dab7fcb3800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788843271.025381:0:13175:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8dab7ffdcd28) has exports, disconnecting them 00000020:00080000:2.0:1788843271.025385:0:13175:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8dab7fcb3800), last request at 1788843051 00000020:00000080:2.0:1788843271.025389:0:13175:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914b10 00000020:00080000:2.0:1788843271.025396:0:13175:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dab7fcb3800): rc 0 00000020:00000080:2.0:1788843271.025400:0:13175:0:(genops.c:885:class_export_put()) final put ffff8dab7fcb3800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788843271.025921:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7fd09800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788843271.025935:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7fcb3800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788843271.032552:0:13175:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788843271.032561:0:13175:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788843271.032565:0:13175:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788843271.032572:0:13175:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788843271.032833:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788843271.032842:0:13175:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1788843271.032849:0:13175:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab7395d800 1 00000020:00000080:3.0:1788843271.032856:0:13175:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914aa0 00000020:00000080:3.0:1788843271.032864:0:13175:0:(genops.c:885:class_export_put()) final put ffff8dab6da27800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1788843271.032869:0:13175:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1788843271.032874:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843271.032878:0:13175:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788843271.032881:0:13175:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8dab60074d28) has no exports 00000020:00000080:0.0:1788843271.033064:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab7d99d000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788843271.033072:0:38:0:(genops.c:885:class_export_put()) final put ffff8dab7fcb5800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788843271.033075:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7fcb5800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788843271.033081:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788843271.033132:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab6da27800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788843271.061573:0:13175:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843271.061674:0:13175:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788843271.061680:0:13175:0:(genops.c:885:class_export_put()) final put ffff8dab7395f800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788843271.061685:0:13175:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7395f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788843271.061693:0:13175:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788843271.061849:0:13175:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dab7395a800 00000020:02000400:0.0:1788843271.061903:0:13175:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788843271.940708:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843272.967656:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1788843273.540987:0:3304:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843257/real 1788843257] req@ffff8dab7c181c00 x1875737795709952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788843273 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843273.576846:0:3304:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8dab7c181c00 x1875737795709952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788843273 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788843273.576865:0:3304:0:(import.c:65:import_set_state_nolock()) ffff8dab77ab2000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788843273.576869:0:3304:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788843273.588508:0:3304:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00100000:0.0:1788843273.588962:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795709952:0@lo:400:kworker.0 00000100:00080000:1.0:1788843273.589315:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 28cf63da-daee-485f-b466-4ec68876f732->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843273.589498:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 28cf63da-daee-485f-b466-4ec68876f732->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843273.589500:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788843273.589505:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788843273.589511:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dab77ab2000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843273.589518:0:38:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 193 00000100:00080000:1.0:1788843273.589530:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dab77ab2000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1788843273.589594:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab6e6be680 x1875737795711104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843273.589672:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875737795711104:0@lo:38:kworker.0 00000400:00000100:2.0:1788843273.589781:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875737795711104 offset 0 length 520: 4 00010000:00010000:1.0:1788843273.989580:0:5835:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788843274.161284:0:13327:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788843274.167707:0:13327:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788843274.167791:0:13327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933aa00/0xc6b8ac1b0914cbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cc2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843274.167807:0:13327:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933aa00/0xc6b8ac1b0914cbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914cc2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843274.167815:0:13327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933aa00/0xc6b8ac1b0914cbb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914cc2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843274.167823:0:13327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab4933aa00/0xc6b8ac1b0914cbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914cc2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843274.167850:0:13327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788843274.167857:0:13327:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1788843274.167976:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843274.167986:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab4933aa00/0xc6b8ac1b0914cbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914cc2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843274.167995:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933aa00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:1.0:1788843274.168000:0:5834:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933aa00/0xc6b8ac1b0914cbb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914cc2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843274.168010:0:5834:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab4933aa00/0xc6b8ac1b0914cbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0914cc2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843274.168018:0:5834:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933aa00/0xc6b8ac1b0914cbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0914cc2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843274.168024:0:5834:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788843274.168027:0:5834:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788843274.168029:0:5834:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788843274.168042:0:5834:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dab43758000 00010000:00010000:1.0:1788843274.168046:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab4933aa00/0xc6b8ac1b0914cbb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b0914cc2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843274.168067:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab4933aa00/0xc6b8ac1b0914cbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b0914cc2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843274.168080:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843274.168082:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843274.168084:0:5834:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788843274.169222:0:13327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788843274.169240:0:13327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dab77b7ce00 x1875737795710464/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843278 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843274.169264:0:13327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dab77b7f800 x1875737795710592/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843281 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843274.169285:0:13327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dab7c183100 x1875737795710720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843286 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843274.169308:0:13327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dab7c180000 x1875737795710976/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843286 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843274.169331:0:13327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dab6e6be680 x1875737795711104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788843283 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843274.169357:0:13327:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788843274.169404:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795710592:0@lo:400:kworker.0 00000100:00100000:0.0:1788843274.169415:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795710464:0@lo:400:kworker.0 00000100:00100000:1.0:1788843274.169505:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795710720:0@lo:400:kworker.0 00000100:00100000:2.0:1788843274.170183:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1875737795710976:0@lo:400:kworker.0 00000100:00080000:2.0:1788843274.170214:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab77ab2000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843274.170217:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:2.0:1788843274.170219:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875737795711104:0@lo:38:kworker.0 00000100:00080000:2.0:1788843274.170234:0:13327:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788843274.170238:0:13327:0:(import.c:65:import_set_state_nolock()) ffff8dab77ab2000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788843274.170242:0:13327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788843274.170244:0:13327:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788843274.170247:0:13327:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788843274.172302:0:13327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a400/0xc6b8ac1b0914cc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914cd0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843274.172337:0:13327:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a400/0xc6b8ac1b0914cc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914cd0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843274.172469:0:13327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a400/0xc6b8ac1b0914cc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914cd0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843274.172474:0:13327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab4933a400/0xc6b8ac1b0914cc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914cd0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843274.172512:0:13327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788843274.172518:0:13327:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914f00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0914f07 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843274.172522:0:13327:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914f00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0914f07 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843274.172527:0:13327:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914f00 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914f07 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843274.172530:0:13327:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914f00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xc6b8ac1b0914f07 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843274.172557:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788843274.172565:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab4933a400/0xc6b8ac1b0914cc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914cd0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843274.172572:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933a400 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:1.0:1788843274.172576:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933a400/0xc6b8ac1b0914cc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914cd0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843274.172584:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab4933a400/0xc6b8ac1b0914cc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0914cd0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843274.172589:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933a400/0xc6b8ac1b0914cc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0914cd0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843274.172603:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788843274.172605:0:7639:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788843274.172631:0:13327:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788843274.172636:0:13327:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1788843274.172641:0:13327:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00010000:00010000:0.0:1788843274.172654:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843274.172660:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914f00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914f07 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788843274.172666:0:13327:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00010000:00010000:0.0:1788843274.172666:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4200 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843274.172669:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914f00 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xc6b8ac1b0914f07 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:3.0:1788843274.172671:0:13327:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00010000:00010000:0.0:1788843274.172676:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914f00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0914f07 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788843274.172677:0:13327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 10000000:00010000:0.0:1788843274.172705:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914f00 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0914f07 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843274.172709:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788843274.172711:0:7637:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788843274.172714:0:7637:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788843274.172721:0:7637:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dab43758000 00010000:00010000:0.0:1788843274.172724:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914f00 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b0914f07 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843274.172731:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0914f00 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b0914f07 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843274.172751:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843274.172753:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843274.172755:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788843274.172762:0:13327:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788843274.172773:0:13327:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8dab7ffd99b8) has no exports 00000020:00080000:3.0:1788843274.172801:0:13327:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8dab7ffd99b8) has no exports 00010000:00010000:1.0:1788843274.172958:0:7639:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dab43758000 00010000:00010000:1.0:1788843274.172963:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab4933a400/0xc6b8ac1b0914cc9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b0914cd0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843274.172971:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab4933a400/0xc6b8ac1b0914cc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b0914cd0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843274.172988:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843274.172990:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843274.172992:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788843274.175624:0:13327:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dab699080c0 - data ffff8dab66ee0948/ffff8dab51a29400 00000020:01000000:3.0:1788843274.175762:0:13327:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dab514a94e0 - data ffff8dab77e206c0/ffff8dab7394d000 00100000:10000000:1.0:1788843274.191853:0:13327:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788843274.223975:0:13327:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914bb1 00000020:00000080:0.0:1788843274.223997:0:13327:0:(genops.c:885:class_export_put()) final put ffff8dab6e6e3000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788843274.224019:0:13327:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dab51a7d800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788843274.224023:0:13327:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab51a7d800 2 00000020:01000004:0.0:1788843274.224026:0:13327:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dab51a7d800 from lustre-OST0001 00000020:00000080:0.0:1788843274.224051:0:13327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843274.224061:0:13327:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788843274.224064:0:13327:0:(genops.c:885:class_export_put()) final put ffff8dab6e6e0000/lustre-OST0001_UUID 00000020:00000080:0.0:1788843274.224066:0:13327:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab6e6e0000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788843274.224073:0:13327:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:2.0:1788843274.224244:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab6e6e3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:0.0:1788843274.224430:0:13327:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 28cf63da-daee-485f-b466-4ec68876f732->MGS 00010000:00010000:0.0:1788843274.224447:0:13327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab4933a800/0xc6b8ac1b0914ac3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0914aca expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843274.224472:0:13327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933a800/0xc6b8ac1b0914ac3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0914aca expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843274.224480:0:13327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788843274.224482:0:13327:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788843274.224486:0:13327:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788843274.224499:0:13327:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dab43758000 00010000:00010000:0.0:1788843274.224503:0:13327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab4933a800/0xc6b8ac1b0914ac3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b0914aca expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843274.224519:0:13327:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab4933a200/0xc6b8ac1b0914d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xc6b8ac1b0914d16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843274.224526:0:13327:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933a200/0xc6b8ac1b0914d0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xc6b8ac1b0914d16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843274.224531:0:13327:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788843274.224533:0:13327:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788843274.224535:0:13327:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788843274.224545:0:13327:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dab43758000 00010000:00010000:0.0:1788843274.224548:0:13327:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab4933a200/0xc6b8ac1b0914d0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xc6b8ac1b0914d16 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788843274.224565:0:13327:0:(import.c:65:import_set_state_nolock()) ffff8dab43758000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788843274.224570:0:13327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788843274.224572:0:13327:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788843274.224573:0:13327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788843274.224578:0:13327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788843274.224590:0:13327:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dab7c182d80 x1875737795710848/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788843285 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788843274.226507:0:13327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788843274.226512:0:13327:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:2.0:1788843274.226836:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:28cf63da-daee-485f-b466-4ec68876f732:3303:1875737795710848:0@lo:250:kworker.0 10000000:01000000:0.0:1788843274.226959:0:13327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788843274.226971:0:13327:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b09149a4 00000020:00000080:0.0:1788843274.226980:0:13327:0:(genops.c:885:class_export_put()) final put ffff8dab4375c800/28cf63da-daee-485f-b466-4ec68876f732 00000020:01000000:0.0:1788843274.227012:0:13327:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.129@tcp (flags='') 00000020:00000080:0.0:1788843274.227018:0:13327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843274.227026:0:13327:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.129@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788843274.227030:0:13327:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8dab600719b8) has no exports 00000020:00000080:3.0:1788843274.227158:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab4375c800/28cf63da-daee-485f-b466-4ec68876f732 for MGC192.168.203.129@tcp 10000000:01000000:2.0:1788843274.227266:0:5844:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788843274.227507:0:13327:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.129@tcp: client import never connected 00000100:00080000:0.0:1788843274.227512:0:13327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788843274.227515:0:13327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788843274.227517:0:13327:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788843274.227519:0:13327:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788843274.227559:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab43758000 for MGC192.168.203.129@tcp 00000020:00000080:0.0:1788843274.227579:0:13327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788843274.227589:0:13327:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.129@tcp (uuid 28cf63da-daee-485f-b466-4ec68876f732) 00000020:00000080:0.0:1788843274.227602:0:13327:0:(genops.c:885:class_export_put()) final put ffff8dab4375d000/28cf63da-daee-485f-b466-4ec68876f732 00000020:00000080:0.0:1788843274.227605:0:13327:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab4375d000/28cf63da-daee-485f-b466-4ec68876f732 for MGC192.168.203.129@tcp 00000020:01000000:0.0:1788843274.227610:0:13327:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.129@tcp (28cf63da-daee-485f-b466-4ec68876f732) 00000020:01000000:0.0:1788843274.227893:0:13327:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788843274.227898:0:13327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788843274.227902:0:13327:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788843274.227908:0:13327:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8dab7fcf7000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788843274.227913:0:13327:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8dab77ac19b8) has exports, disconnecting them 00000020:00080000:0.0:1788843274.227917:0:13327:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8dab7fcf7000), last request at 1788843069 00000020:00000080:0.0:1788843274.227921:0:13327:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914bdb 00000020:00080000:0.0:1788843274.227932:0:13327:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dab7fcf7000): rc 0 00000020:00000080:0.0:1788843274.227935:0:13327:0:(genops.c:885:class_export_put()) final put ffff8dab7fcf7000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788843274.228895:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7fcf7000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788843274.229438:0:13327:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788843274.229443:0:13327:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788843274.229448:0:13327:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788843274.229453:0:13327:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788843274.229624:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8dab77ab2000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1788843274.247457:0:5835:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788843274.247729:0:5834:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1788843274.247854:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:3.0:1788843274.248074:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:0.0:1788843274.248446:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8dab43766a00:5829] 0 exiting: rc = 1 00000100:00100000:0.0:1788843274.248501:0:6717:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8dab4892f200:6717] 2 exiting: rc = 0 00000100:00100000:3.0:1788843274.248684:0:5830:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8dab4364d200:5830] 1 exiting: rc = 0 00000100:00100000:2.0:1788843274.248779:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.249314:0:6708:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8dab7fc8d000:6708] 3 exiting: rc = 0 00000100:00100000:3.0:1788843274.249519:0:7638:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8dab475bee00:7638] 4 exiting: rc = 0 00000100:00100000:3.0:1788843274.249608:0:5833:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8dab69937e00:5833] 2 exiting: rc = 0 00000100:00100000:0.0:1788843274.249717:0:5832:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8dab6998be00:5832] 1 exiting: rc = 0 00000100:00100000:0.0:1788843274.249780:0:5831:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8dab6998ae00:5831] 0 exiting: rc = 1 00000100:00100000:2.0:1788843274.249857:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.249867:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.249875:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.249882:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.249888:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.249895:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.249905:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.249912:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.249918:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.249926:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.249932:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.249937:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.249944:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.249951:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.249958:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.249965:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.249973:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.249979:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250243:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250254:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250260:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250265:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250271:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250276:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250282:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250288:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250293:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250297:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250302:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250307:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250312:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250317:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250322:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250328:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250333:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250386:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250391:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250397:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250402:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250408:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250414:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250419:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250424:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250429:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250434:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250439:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250444:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250450:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250455:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250460:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250466:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250471:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250476:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250481:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250486:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250491:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250496:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250501:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250506:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250511:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250516:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250521:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250525:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.250530:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788843274.252305:0:13327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788843274.252321:0:13327:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788843274.252328:0:13327:0:(genops.c:885:class_export_put()) final put ffff8dab77ab5800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788843274.252336:0:13327:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab77ab5800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788843274.252435:0:13327:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788843274.252478:0:13327:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab51a7d800 1 00000020:00000080:3.0:1788843274.252484:0:13327:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xc6b8ac1b0914b80 00000020:00000080:3.0:1788843274.252491:0:13327:0:(genops.c:885:class_export_put()) final put ffff8dab7fc85800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788843274.252538:0:13327:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788843274.252542:0:13327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843274.252547:0:13327:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788843274.252551:0:13327:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8dab440ecd28) has no exports 00000020:00000080:2.0:1788843274.254789:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab7fc85800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788843274.276252:0:13327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788843274.276277:0:13327:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788843274.276284:0:13327:0:(genops.c:885:class_export_put()) final put ffff8dab51a7f800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788843274.276296:0:13327:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab51a7f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788843274.276336:0:13327:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788843274.276565:0:13327:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dab51a7b000 00000020:01000000:3.0:1788843274.276587:0:13327:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788843274.277955:0:13327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788843274.277979:0:13327:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788843274.277986:0:13327:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8dab440eb370) has no exports 00000020:00000080:3.0:1788843274.278048:0:13327:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788843274.278061:0:13327:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788843274.278067:0:13327:0:(genops.c:885:class_export_put()) final put ffff8dab6da26000/OSS_uuid 00000020:00000080:3.0:1788843274.278071:0:13327:0:(genops.c:844:class_export_destroy()) destroying export ffff8dab6da26000/OSS_uuid for OSS 00000020:01000000:3.0:1788843274.278085:0:13327:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:3.0:1788843274.278159:0:5843:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788843274.279061:0:12070:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8dab47376000:12070] 4 exiting: rc = 0 00000100:00100000:1.0:1788843274.279602:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8dab4934be00:6693] 1 exiting: rc = 0 00000100:00100000:1.0:1788843274.279679:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8dab7c172c00:6692] 0 exiting: rc = 1 00000100:00100000:2.0:1788843274.279697:0:8216:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8dab51a08000:8216] 3 exiting: rc = 0 00000100:00100000:1.0:1788843274.279735:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8dab4934aa00:6694] 2 exiting: rc = 0 00000100:00100000:3.0:1788843274.283785:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283797:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283804:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283813:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283817:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283822:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283827:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283832:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283838:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283844:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283849:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283854:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283859:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283864:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283870:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283876:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283881:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283886:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283891:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283896:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283902:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283907:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283912:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283933:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283938:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283954:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283960:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.283965:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287290:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287301:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287307:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287312:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287317:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287322:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287328:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287334:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287359:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287366:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287372:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287377:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287382:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287389:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287395:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287400:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287405:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287411:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287418:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287425:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287432:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287437:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287442:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287446:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287451:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287456:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287464:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287471:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287478:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287485:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287846:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287855:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287862:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287870:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287876:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.287881:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788843274.290435:0:8474:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8dab7ce6de00:8474] 2 exiting: rc = 0 00000100:00100000:1.0:1788843274.290585:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8dab49338000:6696] 0 exiting: rc = 1 00000100:00100000:2.0:1788843274.291602:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8dab7b968c00:6697] 1 exiting: rc = 0 00000100:00100000:3.0:1788843274.294413:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294429:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294434:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294440:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294445:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294451:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294456:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294461:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294466:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294473:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294479:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294484:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294489:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294494:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294499:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294504:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294509:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294514:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294519:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294524:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294530:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294535:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294540:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294544:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294550:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294554:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294560:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294566:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294571:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294608:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294614:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294620:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294625:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294631:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294637:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294643:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294649:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294654:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294667:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294673:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294680:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294684:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294689:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294694:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294699:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294704:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294709:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294715:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294721:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294726:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294730:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294736:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294741:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294746:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294751:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294757:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294761:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294766:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294771:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294777:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294781:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294786:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294792:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.294798:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.302182:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8dab51561600:6699] 1 exiting: rc = 0 00000100:00100000:1.0:1788843274.302315:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8dab7c209e00:6700] 2 exiting: rc = 0 00000100:00100000:1.0:1788843274.302619:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8dab7c209400:6698] 0 exiting: rc = 1 00000100:00100000:2.0:1788843274.305958:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.305983:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.305989:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.305995:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306001:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306007:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306013:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306019:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306025:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306030:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306179:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306185:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306191:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306196:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306202:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306208:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306215:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306221:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306229:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306237:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306244:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306250:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306256:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306261:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306266:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306271:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306276:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306281:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306287:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306294:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306387:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306396:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306402:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306409:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306436:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306448:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306462:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306479:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.306485:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307216:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307232:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307239:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307246:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307254:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307261:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307272:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307278:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307284:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307292:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307394:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307404:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307410:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307417:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307424:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307429:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307436:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307442:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307448:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307454:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307460:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307476:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307482:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307708:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.307719:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.316688:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8dab7c20ee00:6702] 1 exiting: rc = 0 00000100:00100000:0.0:1788843274.317042:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8dab7c20f600:6701] 0 exiting: rc = 1 00000100:00100000:3.0:1788843274.317193:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317202:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317209:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317215:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317220:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317225:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317232:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317239:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317246:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317252:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317259:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317264:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317270:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317275:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317281:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317287:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317306:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317314:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317319:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317325:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317332:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317338:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317379:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317385:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317391:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317397:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317403:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317408:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317414:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317419:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317425:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317430:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317436:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317441:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317446:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317471:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317477:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317483:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317489:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317497:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317502:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317507:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317513:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317518:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317523:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317531:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317537:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317546:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317553:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317560:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317566:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317571:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317577:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317583:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317589:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317605:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317611:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317616:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317622:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317628:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317633:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317639:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317644:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788843274.317651:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788843274.319457:0:6704:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8dab51a22200:6704] 1 exiting: rc = 0 00000100:00100000:0.0:1788843274.319615:0:6703:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8dab7c20e400:6703] 0 exiting: rc = 1 00000100:00100000:2.0:1788843274.320336:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320369:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320378:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320387:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320397:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320405:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320425:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320433:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320440:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320447:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320454:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320463:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320491:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320499:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320504:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320511:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320517:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320523:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320529:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320535:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320540:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320545:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320551:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320559:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320579:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320588:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320606:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320612:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320618:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320624:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320630:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320636:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320642:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320649:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320656:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320661:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320684:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320692:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320699:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320704:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320712:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320729:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320736:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320742:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320750:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320756:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320762:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320769:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320792:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320801:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320807:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320813:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320820:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320828:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320835:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320840:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320848:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320856:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320866:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320871:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320895:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320904:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320909:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788843274.320916:0:13327:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788843274.338977:0:13327:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788843290.706935:0:13941:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788843299.290202:0:14402:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788843299.290212:0:14402:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788843299.290402:0:14402:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dab7c1e8000 00000020:01000004:3.0:1788843299.290433:0:14402:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788843299.290445:0:14402:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788843299.290476:0:14402:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8dab477d8000) 00000020:00000080:3.0:1788843299.290497:0:14402:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788843299.349789:0:14402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788843299.353169:0:14402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788843299.353591:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 339: rc = 0 00100000:10000000:3.0:1788843299.353814:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 339: rc = 0 00100000:10000000:3.0:1788843299.353993:0:14402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788843299.354062:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 339: rc = 0 00100000:10000000:3.0:1788843299.354172:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 339: rc = 0 00100000:10000000:3.0:1788843299.354264:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 339: rc = 0 00100000:10000000:3.0:1788843299.355108:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 339: rc = 0 00100000:10000000:3.0:1788843299.355909:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 341: rc = 0 00100000:10000000:3.0:1788843299.358118:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 640: rc = 0 00100000:10000000:3.0:1788843299.358227:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 640: rc = 0 00100000:10000000:3.0:1788843299.359038:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 645: rc = 0 00100000:10000000:3.0:1788843299.359581:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 645: rc = 0 00100000:10000000:3.0:1788843299.360004:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 645: rc = 0 00100000:10000000:3.0:1788843299.360516:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 645: rc = 0 00100000:10000000:3.0:1788843299.360819:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 645: rc = 0 00100000:10000000:3.0:1788843299.361102:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 645: rc = 0 00100000:10000000:3.0:1788843299.361529:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 645: rc = 0 00100000:10000000:3.0:1788843299.361826:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 645: rc = 0 00100000:10000000:3.0:1788843299.362100:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 645: rc = 0 00100000:10000000:3.0:1788843299.362493:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 645: rc = 0 00100000:10000000:3.0:1788843299.363541:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 645: rc = 0 00100000:10000000:3.0:1788843299.363963:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 645: rc = 0 00100000:10000000:3.0:1788843299.365563:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 359: rc = 0 00100000:10000000:3.0:1788843299.366038:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 359: rc = 0 00100000:10000000:3.0:1788843299.366823:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 359: rc = 0 00100000:10000000:3.0:1788843299.367151:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 359: rc = 0 00100000:10000000:3.0:1788843299.369048:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 359: rc = 0 00100000:10000000:3.0:1788843299.370532:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 359: rc = 0 00100000:10000000:2.0:1788843299.372202:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 359: rc = 0 00100000:10000000:2.0:1788843299.373171:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 359: rc = 0 00100000:10000000:2.0:1788843299.374638:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 359: rc = 0 00100000:10000000:2.0:1788843299.375631:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 359: rc = 0 00100000:10000000:2.0:1788843299.376969:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 359: rc = 0 00100000:10000000:2.0:1788843299.377235:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 359: rc = 0 00100000:10000000:2.0:1788843299.378850:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 359: rc = 0 00100000:10000000:2.0:1788843299.381471:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 359: rc = 0 00100000:10000000:2.0:1788843299.382924:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 359: rc = 0 00100000:10000000:2.0:1788843299.383176:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 359: rc = 0 00100000:10000000:2.0:1788843299.383701:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 359: rc = 0 00100000:10000000:2.0:1788843299.383956:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 359: rc = 0 00100000:10000000:2.0:1788843299.384168:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 359: rc = 0 00100000:10000000:2.0:1788843299.384465:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 359: rc = 0 00100000:10000000:2.0:1788843299.384703:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 359: rc = 0 00100000:10000000:2.0:1788843299.384946:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 359: rc = 0 00100000:10000000:2.0:1788843299.385207:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 359: rc = 0 00100000:10000000:2.0:1788843299.386834:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 359: rc = 0 00100000:10000000:2.0:1788843299.387731:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 359: rc = 0 00100000:10000000:2.0:1788843299.388092:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 359: rc = 0 00100000:10000000:2.0:1788843299.388606:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 359: rc = 0 00100000:10000000:2.0:1788843299.389008:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 359: rc = 0 00100000:10000000:2.0:1788843299.389434:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 359: rc = 0 00100000:10000000:2.0:1788843299.390176:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 359: rc = 0 00100000:10000000:2.0:1788843299.390838:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 359: rc = 0 00100000:10000000:2.0:1788843299.391161:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 359: rc = 0 00100000:10000000:2.0:1788843299.391810:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 524: rc = 0 00100000:10000000:2.0:1788843299.392622:0:14402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788843299.392972:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 348: rc = 0 00100000:10000000:2.0:1788843299.393232:0:14402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788843299.393487:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 348: rc = 0 00100000:10000000:2.0:1788843299.393751:0:14402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788843299.393814:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 348: rc = 0 00100000:10000000:2.0:1788843299.394970:0:14402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788843299.395064:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 641: rc = 0 00100000:10000000:2.0:1788843299.395442:0:14402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788843299.395512:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 641: rc = 0 00100000:10000000:2.0:1788843299.395783:0:14402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788843299.395846:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 641: rc = 0 00000020:00000080:2.0:1788843299.396831:0:14402:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788843299.396839:0:14402:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788843299.396850:0:14402:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b0915ca5 00000020:01000004:2.0:1788843299.396858:0:14402:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788843299.396933:0:14402:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788843299.396939:0:14402:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dab7c1e8000 from MGS 00000020:01000004:2.0:1788843299.396943:0:14402:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788843299.396954:0:14402:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8dab7ffdb370) 00000020:00000080:2.0:1788843299.396965:0:14402:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788843299.397022:0:14402:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dab7c1e8000 from MGS, refs=2 00080000:01000000:2.0:1788843299.397027:0:14402:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788843299.397032:0:14402:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b0915cb3 00000100:00100000:2.0:1788843299.397135:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788843299.397503:0:14402:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788843299.397510:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788843299.398112:0:14402:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788843299.398118:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788843299.398956:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843299.399180:0:14402:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788843299.399186:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788843299.400013:0:14402:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788843299.400022:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788843299.404310:0:14402:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788843299.404322:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788843299.405983:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843299.405988:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843299.405990:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843299.410759:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843299.410765:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843299.410768:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843299.411533:0:14402:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788843299.413064:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788843299.430011:0:14402:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788843299.430029:0:14402:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788843299.430032:0:14402:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1788843299.439591:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788843299.439815:0:14402:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788843299.439940:0:14402:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788843299.440897:0:14402:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788843299.442313:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788843299.442535:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788843299.442541:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788843299.451871:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788843299.451885:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788843299.458271:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788843299.462570:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788843299.467227:0:14402:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788843299.467252:0:14402:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.129@tcp' 00000020:01000004:3.0:1788843299.467254:0:14402:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788843299.467284:0:14402:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.129@tcp (typ=mgc) 00000020:00000080:3.0:1788843299.467297:0:14402:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.129@tcp (ffff8dab477db370) 00000020:00000080:3.0:1788843299.467314:0:14402:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788843299.467906:0:14402:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dab7c1e8800@MGC192.168.203.129@tcp: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1788843299.468217:0:14402:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.129@tcp-0 is initialized 00000040:01000000:3.0:1788843299.468225:0:14402:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788843299.468735:0:14416:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1788843299.471509:0:14417:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788843299.471607:0:14402:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.129@tcp (uuid 845ba2f4-9198-464f-ba29-11072ff30647) 00000020:00000080:1.0:1788843299.471638:0:14402:0:(genops.c:1385:class_connect()) connect: client 845ba2f4-9198-464f-ba29-11072ff30647, cookie 0xc6b8ac1b0915cc1 00000100:00080000:1.0:1788843299.471651:0:14402:0:(import.c:510:import_select_connection()) MGC192.168.203.129@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788843299.471672:0:14402:0:(import.c:624:import_select_connection()) MGC192.168.203.129@tcp: import ffff8dab7c1e8800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1788843299.471720:0:14402:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab6e6bfb80 x1875737795711232/t0(0) o250->MGC192.168.203.129@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843299.471739:0:14402:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 845ba2f4-9198-464f-ba29-11072ff30647->MGS 00000020:01000004:1.0:1788843299.471770:0:14402:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788843299.471776:0:14402:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788843299.471790:0:14402:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8dab60073370) 00000020:00000080:1.0:1788843299.471803:0:14402:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788843299.471954:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:845ba2f4-9198-464f-ba29-11072ff30647:3303:1875737795711232:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788843299.472019:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843299.472105:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795711232 00000100:00100000:2.0:1788843299.472112:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795711232 00000100:00100000:2.0:1788843299.472150:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843299.472156:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1875737795711232:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788843299.472177:0:14413:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 845ba2f4-9198-464f-ba29-11072ff30647@0@lo t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:2.0:1788843299.472199:0:14413:0:(genops.c:1385:class_connect()) connect: client 845ba2f4-9198-464f-ba29-11072ff30647, cookie 0xc6b8ac1b0915ccf 00000100:00080000:2.0:1788843299.472324:0:14413:0:(import.c:65:import_set_state_nolock()) ffff8dab4378b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843299.472400:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+5:3303:x1875737795711232:12345-0@lo:250:mount.lustre.0 Request processed in 242us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843299.473189:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843299.473240:0:3303:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.129@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788843299.473249:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.129@tcp: connect to target with instance 0 00000100:00080000:2.0:1788843299.473256:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.129@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788843299.473261:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788843299.473264:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab7c1e8800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788843299.473267:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788843299.473282:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788843299.473288:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:845ba2f4-9198-464f-ba29-11072ff30647:3303:1875737795711232:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788843299.513126:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788843299.513641:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788843299.513659:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788843299.521568:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788843299.521699:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788843299.523840:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788843299.523850:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788843299.525414:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843299.525634:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788843299.525639:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788843299.532114:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788843299.532134:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1788843299.614291:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843299.614666:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1788843299.614671:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788843299.615622:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788843299.615632:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788843299.618270:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843299.618533:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788843299.618538:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788843299.620567:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788843299.620579:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788843299.621197:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843299.621540:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788843299.621546:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788843299.622151:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788843299.622161:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788843299.622843:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843299.623028:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788843299.623033:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788843299.623511:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788843299.623517:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788843299.684442:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843299.689058:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788843299.689078:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788843299.691178:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788843299.691194:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788843299.700263:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788843299.700283:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788843299.711404:0:14402:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788843299.711439:0:14402:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788843299.711445:0:14402:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788843299.711580:0:14402:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788843299.711626:0:14402:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.129@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1788843299.711630:0:14402:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788843299.711631:0:14402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788843299.711633:0:14402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843299.711634:0:14402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843299.711635:0:14402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843299.711636:0:14402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843299.711641:0:14402:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788843299.711642:0:14402:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788843299.711644:0:14402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843299.711645:0:14402:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788843299.711647:0:14402:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1788843299.711649:0:14402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788843299.711650:0:14402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788843299.711651:0:14402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843299.711652:0:14402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843299.711652:0:14402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843299.711653:0:14402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843299.711654:0:14402:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788843299.711655:0:14402:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788843299.711655:0:14402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843299.711656:0:14402:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788843299.711681:0:14402:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788843299.711699:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c181500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795711360:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788843299.711770:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843299.711818:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795711360 00000100:00100000:3.0:1788843299.711824:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4939a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843299.711826:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795711360 00000100:00100000:2.0:1788843299.711863:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788843299.711871:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+5:14402:x1875737795711360:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788843299.712004:0:14415:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788843299.712007:0:14415:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788843299.712009:0:14415:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788843299.713568:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788843299.714618:0:14415:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1788843299.723524:0:14437:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1788843299.723535:0:14437:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1788843299.723553:0:14437:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1788843299.723591:0:14437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788843299.730265:0:14415:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788843299.730278:0:14415:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788843299.751208:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+5:14402:x1875737795711360:12345-0@lo:253:mount.lustre.0 Request processed in 39320us (39422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843299.751232:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843299.751730:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c181500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795711360:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788843299.751747:0:14402:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788843299.751751:0:14402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788843299.751753:0:14402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788843299.751754:0:14402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843299.751755:0:14402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843299.751757:0:14402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843299.751758:0:14402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843299.751759:0:14402:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788843299.751761:0:14402:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788843299.751762:0:14402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843299.751764:0:14402:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788843299.751786:0:14402:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dab7c1e8000 from lustre-MDT0000 10000000:01000000:1.0:1788843299.751814:0:14402:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788843299.751817:0:14402:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788843299.751821:0:14402:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8dab477db370 10000000:01000000:1.0:1788843299.751826:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788843299.751848:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dab477db370 from 1 10000000:01000000:1.0:1788843299.751851:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788843299.751895:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0915cd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.751906:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0915cd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.751916:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0915cd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843299.751938:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795711488:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788843299.751981:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843299.752026:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51597900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843299.752583:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795711488 00000100:00100000:2.0:1788843299.752592:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795711488 00000100:00100000:2.0:1788843299.752639:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843299.752647:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+5:14402:x1875737795711488:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843299.752669:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843299.752687:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab49374800/0xc6b8ac1b0915cdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0915cd6 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843299.752710:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab49374800/0xc6b8ac1b0915cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0915cd6 expref: 6 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843299.752721:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab49374800/0xc6b8ac1b0915cdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915cd6 expref: 6 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843299.752730:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374800, rc 0) 00000100:00100000:2.0:1788843299.752773:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+6:14402:x1875737795711488:12345-0@lo:101:mount.lustre.0 Request processed in 126us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843299.752780:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788843299.753000:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795711488:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843299.753014:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0915cd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915cdd expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.753022:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0915cd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915cdd expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843299.753074:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795711616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843299.753098:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843299.753125:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51597900 going to sleep for 11 seconds 00000100:00100000:3.0:1788843299.753166:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795711616 00000100:00100000:3.0:1788843299.753171:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795711616 00000100:00100000:3.0:1788843299.753193:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843299.753199:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+6:14402:x1875737795711616:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843299.753464:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+6:14402:x1875737795711616:12345-0@lo:501:mount.lustre.0 Request processed in 263us (363us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788843299.753470:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843299.753617:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795711616:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788843299.753642:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788843299.753666:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0915cd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915cdd expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.753674:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0915cd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915cdd expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843299.753682:0:14402:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dab7c1e8000 10000000:01000000:1.0:1788843299.753686:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788843299.753690:0:14402:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dab7c1e8000 10000000:01000000:1.0:1788843299.753692:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788843299.753695:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dab7c1e8000 from 1 10000000:01000000:1.0:1788843299.753697:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788843299.753714:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0915ce4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.753721:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0915ce4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.753736:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0915ce4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843299.753748:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795711744:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788843299.753772:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843299.753793:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51597900 going to sleep for 11 seconds 00000100:00100000:3.0:1788843299.754216:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795711744 00000100:00100000:3.0:1788843299.754221:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795711744 00000100:00100000:3.0:1788843299.754262:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843299.754269:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+6:14402:x1875737795711744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843299.754278:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843299.754292:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7799f800/0xc6b8ac1b0915ceb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0915ce4 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843299.754309:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7799f800/0xc6b8ac1b0915ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0915ce4 expref: 7 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843299.754327:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7799f800/0xc6b8ac1b0915ceb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915ce4 expref: 7 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843299.754334:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799f800, rc 0) 00000100:00100000:3.0:1788843299.754386:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+7:14402:x1875737795711744:12345-0@lo:101:mount.lustre.0 Request processed in 118us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843299.754392:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843299.754675:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795711744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843299.754687:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0915ce4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915ceb expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.754696:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0915ce4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915ceb expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843299.754709:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788843299.754725:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0915ce4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915ceb expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.754732:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933b800/0xc6b8ac1b0915ce4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915ceb expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843299.754739:0:14402:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788843299.754743:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788843299.754747:0:14402:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dab7c1e8000 10000000:01000000:1.0:1788843299.754750:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788843299.754753:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788843299.754755:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788843299.754772:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a000/0xc6b8ac1b0915cf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.754785:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab4933a000/0xc6b8ac1b0915cf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.754793:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab4933a000/0xc6b8ac1b0915cf2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843299.754807:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795711872:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788843299.754849:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843299.754868:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51597900 going to sleep for 11 seconds 00000100:00100000:3.0:1788843299.755075:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795711872 00000100:00100000:3.0:1788843299.755080:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795711872 00000100:00100000:3.0:1788843299.755111:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843299.755119:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+7:14402:x1875737795711872:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843299.755128:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843299.755136:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7799ea00/0xc6b8ac1b0915cf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0915cf2 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843299.755150:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7799ea00/0xc6b8ac1b0915cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0915cf2 expref: 8 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843299.755158:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7799ea00/0xc6b8ac1b0915cf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915cf2 expref: 8 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843299.755175:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799ea00, rc 0) 00000100:00100000:3.0:1788843299.755217:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+8:14402:x1875737795711872:12345-0@lo:101:mount.lustre.0 Request processed in 99us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843299.755224:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843299.759468:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795711872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843299.759504:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab4933a000/0xc6b8ac1b0915cf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915cf9 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.759518:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab4933a000/0xc6b8ac1b0915cf2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915cf9 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843299.759606:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795712000:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843299.759685:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843299.759731:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51597900 going to sleep for 11 seconds 00000100:00100000:3.0:1788843299.759962:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795712000 00000100:00100000:3.0:1788843299.759970:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795712000 00000100:00100000:3.0:1788843299.760020:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788843299.760030:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+8:14402:x1875737795712000:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843299.760504:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+9:14402:x1875737795712000:12345-0@lo:501:mount.lustre.0 Request processed in 475us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843299.760512:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788843299.760603:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795712000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843299.760637:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795712128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843299.760690:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843299.760725:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab504520c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843299.760960:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795712128 00000100:00100000:1.0:1788843299.760965:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795712128 00000100:00100000:1.0:1788843299.761037:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843299.761045:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+9:14402:x1875737795712128:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843299.761387:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+9:14402:x1875737795712128:12345-0@lo:503:mount.lustre.0 Request processed in 342us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843299.761395:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788843299.761957:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffa300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795712128:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843299.764207:0:14438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:845ba2f4-9198-464f-ba29-11072ff30647:14438:1875737795712256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843299.764289:0:14438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843299.764332:0:14438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab515976c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843299.764357:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795712256 00000100:00100000:2.0:1788843299.764364:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795712256 00000100:00100000:2.0:1788843299.764414:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788843299.764428:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+9:14438:x1875737795712256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843299.764662:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+9:14438:x1875737795712256:12345-0@lo:502:llog_process_th.0 Request processed in 242us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843299.764668:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843299.764698:0:14438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:845ba2f4-9198-464f-ba29-11072ff30647:14438:1875737795712256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788843299.764727:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843299.764737:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843299.764740:0:14438:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788843299.764746:0:14438:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788843299.764749:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788843299.764762:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8dab60070000) 00000020:00000080:1.0:1788843299.764780:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788843299.764786:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788843299.764861:0:14438:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788843299.764868:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b0915d07 00000020:00000080:1.0:1788843299.765079:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788843299.765084:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843299.765088:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843299.765090:0:14438:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788843299.765092:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843299.765096:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843299.765098:0:14438:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788843299.765101:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788843299.765109:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8dab600719b8) 00000020:00000080:1.0:1788843299.765118:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788843299.765123:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788843299.765124:0:14438:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788843299.765185:0:14438:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788843299.765194:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788843299.765244:0:14438:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dab7c1e8000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788843299.765258:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8dab60074d28) 00000020:00000080:1.0:1788843299.765267:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788843299.765318:0:14438:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788843299.765324:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b8ac1b0915d1c 00000020:00000080:1.0:1788843299.765595:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788843299.765602:0:14438:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788843299.765606:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xc6b8ac1b0915d23 00080000:01000000:1.0:1788843299.765612:0:14438:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788843299.765620:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b0915d2a 00010000:00010000:0.0:1788843299.819495:0:14438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788843299.819920:0:14438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:0.0:1788843299.820093:0:14438:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788843299.820561:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8dab77ac3370) 00000020:00000080:0.0:1788843299.820578:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788843299.820643:0:14438:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788843299.820650:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b0915d38 00000020:00000080:0.0:1788843299.820974:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788843299.824211:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xc6b8ac1b0915d3f 00000020:00000080:0.0:1788843299.824674:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788843299.824687:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843299.824694:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843299.824696:0:14438:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788843299.824700:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788843299.824703:0:14438:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788843299.824705:0:14438:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788843299.824707:0:14438:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788843299.824708:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788843299.824712:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843299.824714:0:14438:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788843299.824719:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843299.824725:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843299.824726:0:14438:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788843299.824732:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788843299.824773:0:14438:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788843299.824784:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843299.824788:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843299.824790:0:14438:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788843299.824792:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788843299.824795:0:14438:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788843299.824800:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843299.824801:0:14438:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788843299.824804:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788843299.824809:0:14438:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:0.0:1788843299.824837:0:14438:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788843299.824840:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788843299.824855:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8dab77ac4d28) 00000020:00000080:0.0:1788843299.824869:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788843299.824874:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788843299.824924:0:14438:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788843299.824929:0:14438:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788843299.824936:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b0915d4d 00010000:00080000:0.0:1788843299.824974:0:14438:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dab50397800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:0.0:1788843299.825215:0:14438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1788843299.825646:0:14438:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788843299.825685:0:14438:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788843299.826597:0:14438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788843299.826662:0:14438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788843299.826725:0:14438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788843299.827185:0:14442:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788843299.827190:0:14442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788843299.827863:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788843299.827875:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788843299.827901:0:14438:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788843299.827921:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b8ac1b0915d54 00000100:00080000:1.0:1788843299.827931:0:14438:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788843299.827938:0:14438:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dab50397800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1788843299.827977:0:14438:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab6e6bc700 x1875737795712384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843299.828010:0:14438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:3.0:1788843299.828106:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795712384:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788843299.828165:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875737795712384 offset 0 length 520: 4 00000020:01000000:1.0:1788843299.828233:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843299.828238:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843299.828240:0:14438:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788843299.828243:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788843299.828245:0:14438:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788843299.828247:0:14438:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788843299.828248:0:14438:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788843299.828250:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788843299.828252:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843299.828253:0:14438:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788843299.828256:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788843299.828260:0:14438:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788843299.828263:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843299.828265:0:14438:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788843299.828268:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788843299.828271:0:14438:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.129@tcp to nid 0x20000c0a8cb81 (192.168.203.129@tcp) 00000020:01000000:1.0:1788843299.828299:0:14438:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788843299.828302:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788843299.828409:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8dab6f870000) 00000020:00000080:1.0:1788843299.828435:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788843299.828443:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788843299.828509:0:14438:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788843299.828513:0:14438:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788843299.828520:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xc6b8ac1b0915d62 00010000:00080000:1.0:1788843299.828550:0:14438:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dab48813000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:1.0:1788843299.828763:0:14438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788843299.828909:0:14438:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788843299.828932:0:14438:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788843299.829562:0:14438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843299.829621:0:14438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788843299.829665:0:14438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788843299.830082:0:14444:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788843299.830087:0:14444:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788843299.830522:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788843299.830530:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788843299.830552:0:14438:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788843299.830567:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b8ac1b0915d69 00000100:00080000:1.0:1788843299.830575:0:14438:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788843299.830579:0:14438:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dab48813000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1788843299.830609:0:14438:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab6e6be300 x1875737795712512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843299.830628:0:14438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788843299.830664:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795712512:0@lo:8:llog_process_th.0 00000020:01000000:1.0:1788843299.830676:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843299.830680:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843299.830681:0:14438:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788843299.830684:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843299.830694:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843299.830695:0:14438:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788843299.830698:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788843299.830700:0:14438:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788843299.830703:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843299.830705:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843299.830706:0:14438:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788843299.830709:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843299.830711:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843299.830712:0:14438:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788843299.830715:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000400:00000100:3.0:1788843299.830717:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875737795712512 offset 0 length 520: 4 00000100:00100000:1.0:1788843299.830743:0:14438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:845ba2f4-9198-464f-ba29-11072ff30647:14438:1875737795712640:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843299.830789:0:14438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843299.830810:0:14438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab42cc0240 going to sleep for 11 seconds 00000100:00100000:3.0:1788843299.830855:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795712640 00000100:00100000:3.0:1788843299.830862:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795712640 00000100:00100000:3.0:1788843299.830902:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788843299.830911:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+9:14438:x1875737795712640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843299.831194:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+9:14438:x1875737795712640:12345-0@lo:502:llog_process_th.0 Request processed in 281us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843299.831204:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788843299.831492:0:14438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:845ba2f4-9198-464f-ba29-11072ff30647:14438:1875737795712640:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788843299.831521:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843299.831527:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843299.831528:0:14438:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788843299.831532:0:14438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788843299.831685:0:14402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1788843299.831706:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788843299.831721:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a000/0xc6b8ac1b0915cf2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915cf9 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843299.831733:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933a000/0xc6b8ac1b0915cf2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915cf9 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843299.831741:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dab7c1e8000 from 1 10000000:01000000:0.0:1788843299.831744:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788843299.831776:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0915d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843299.831784:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0915d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843299.831792:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0915d70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843299.831809:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795712768:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788843299.831847:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843299.831886:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab492eb000 going to sleep for 11 seconds 00000100:00100000:2.0:1788843299.840133:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795712768 00000100:00100000:2.0:1788843299.840151:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795712768 00000100:00100000:2.0:1788843299.840309:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843299.840323:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+9:14402:x1875737795712768:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843299.840360:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843299.840383:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab49374c00/0xc6b8ac1b0915d77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0915d70 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843299.840413:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab49374c00/0xc6b8ac1b0915d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0915d70 expref: 10 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843299.840438:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab49374c00/0xc6b8ac1b0915d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915d70 expref: 10 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843299.840458:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374c00, rc 0) 00000100:00100000:2.0:1788843299.840541:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+10:14402:x1875737795712768:12345-0@lo:101:mount.lustre.0 Request processed in 221us (8692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843299.840551:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788843299.840989:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795712768:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843299.841012:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0915d70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915d77 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843299.841021:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0915d70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915d77 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843299.844853:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795712896:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788843299.844958:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843299.845014:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab492eb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788843299.845591:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795712896 00000100:00100000:3.0:1788843299.845601:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795712896 00000100:00100000:3.0:1788843299.845678:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788843299.845688:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+10:14402:x1875737795712896:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788843299.845715:0:14414:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788843299.845722:0:14414:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788843299.845840:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+10:14402:x1875737795712896:12345-0@lo:256:mount.lustre.0 Request processed in 153us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843299.845848:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788843299.846020:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795712896:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788843299.847956:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788843299.847987:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0915d70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915d77 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843299.848001:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0915d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915d77 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843299.848011:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab7c1e8000 from 1 10000000:01000000:0.0:1788843299.848015:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843299.848651:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0915d7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843299.848661:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0915d7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843299.848672:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0915d7e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843299.848714:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795713024:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788843299.848782:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843299.848924:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab492eb000 going to sleep for 11 seconds 00000100:00100000:2.0:1788843299.852254:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795713024 00000100:00100000:2.0:1788843299.852269:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795713024 00000100:00100000:2.0:1788843299.853215:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843299.853228:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+10:14402:x1875737795713024:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843299.853246:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843299.853281:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab49375200/0xc6b8ac1b0915d85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0915d7e expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843299.853312:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab49375200/0xc6b8ac1b0915d85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0915d7e expref: 11 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843299.853324:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab49375200/0xc6b8ac1b0915d85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915d7e expref: 11 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843299.853332:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375200, rc 0) 00000100:00100000:2.0:1788843299.853448:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+11:14402:x1875737795713024:12345-0@lo:101:mount.lustre.0 Request processed in 216us (4659us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843299.853456:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788843299.854206:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795713024:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843299.854230:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0915d7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915d85 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843299.854241:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0915d7e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915d85 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843299.854319:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795713152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843299.854389:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843299.854435:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab492eb000 going to sleep for 11 seconds 00000100:00100000:1.0:1788843299.855797:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795713152 00000100:00100000:1.0:1788843299.855812:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795713152 00000100:00100000:1.0:1788843299.855862:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788843299.855872:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+11:14402:x1875737795713152:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843299.856733:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+11:14402:x1875737795713152:12345-0@lo:501:mount.lustre.0 Request processed in 859us (2341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843299.856743:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788843299.856907:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795713152:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843299.856958:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795713280:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843299.857007:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843299.857051:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab492eb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788843299.857194:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795713280 00000100:00100000:3.0:1788843299.857201:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795713280 00000100:00100000:3.0:1788843299.857288:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788843299.857298:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+11:14402:x1875737795713280:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843299.857502:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+11:14402:x1875737795713280:12345-0@lo:503:mount.lustre.0 Request processed in 205us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843299.857510:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788843299.857608:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795713280:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843299.858751:0:14446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:845ba2f4-9198-464f-ba29-11072ff30647:14446:1875737795713408:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843299.858821:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843299.860214:0:14446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab492eb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843299.860311:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795713408 00000100:00100000:2.0:1788843299.860321:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795713408 00000100:00100000:1.0:1788843299.862160:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788843299.862178:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+11:14446:x1875737795713408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788843299.862806:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+11:14446:x1875737795713408:12345-0@lo:502:llog_process_th.0 Request processed in 624us (3975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843299.862823:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788843299.862981:0:14446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:845ba2f4-9198-464f-ba29-11072ff30647:14446:1875737795713408:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788843299.863016:0:14446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843299.863030:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843299.863093:0:14446:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788843299.863103:0:14446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dab7c1e8000 00000020:00000080:0.0:1788843299.863106:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843299.863113:0:14446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843299.863115:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843299.863117:0:14446:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788843299.863119:0:14446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843299.863122:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843299.863123:0:14446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788843299.863126:0:14446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dab7c1e8000 00000020:00000080:0.0:1788843299.863128:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788843299.863224:0:14446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788843299.863228:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843299.863229:0:14446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788843299.863232:0:14446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788843299.863234:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788843299.863235:0:14446:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788843299.863238:0:14446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dab7c1e8000 00000020:00000080:0.0:1788843299.863241:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788843299.863898:0:14446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:845ba2f4-9198-464f-ba29-11072ff30647:14446:1875737795713536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788843299.863962:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843299.864046:0:14446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab492eb9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843299.876947:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795713536 00000100:00100000:3.0:1788843299.876963:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795713536 00000100:00100000:3.0:1788843299.877120:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788843299.877132:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+11:14446:x1875737795713536:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843299.877427:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+11:14446:x1875737795713536:12345-0@lo:502:llog_process_th.0 Request processed in 288us (13456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843299.877436:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788843299.877502:0:14446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:845ba2f4-9198-464f-ba29-11072ff30647:14446:1875737795713536:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788843299.877534:0:14446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843299.877541:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843299.877544:0:14446:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788843299.877549:0:14446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788843299.878168:0:14402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788843299.878193:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788843299.878212:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0915d7e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915d85 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.878225:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0915d7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915d85 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843299.878267:0:14402:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788843299.878271:0:14402:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dab7c1e8000 10000000:01000000:1.0:1788843299.878274:0:14402:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dab7c1e8000 10000000:01000000:1.0:1788843299.878278:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788843299.878283:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dab7c1e8000 from 1 10000000:01000000:1.0:1788843299.878286:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788843299.878318:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933be00/0xc6b8ac1b0915d8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.878327:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab4933be00/0xc6b8ac1b0915d8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.878337:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab4933be00/0xc6b8ac1b0915d8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843299.878373:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795713664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788843299.878417:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843299.878460:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7770ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788843299.878486:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795713664 00000100:00100000:1.0:1788843299.878491:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795713664 00000100:00100000:1.0:1788843299.878532:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788843299.878538:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+11:14402:x1875737795713664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843299.878549:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843299.878563:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab4933b400/0xc6b8ac1b0915d93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0915d8c expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.878585:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab4933b400/0xc6b8ac1b0915d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0915d8c expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.878595:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab4933b400/0xc6b8ac1b0915d93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915d8c expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.878602:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b400, rc 0) 00000100:00100000:1.0:1788843299.879226:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+12:14402:x1875737795713664:12345-0@lo:101:mount.lustre.0 Request processed in 684us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843299.879235:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788843299.880332:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795713664:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843299.880382:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab4933be00/0xc6b8ac1b0915d8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915d93 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843299.880394:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab4933be00/0xc6b8ac1b0915d8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915d93 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843299.880485:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795713792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843299.880534:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843299.880573:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab50452540 going to sleep for 11 seconds 00000100:00100000:3.0:1788843299.882156:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795713792 00000100:00100000:3.0:1788843299.882180:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795713792 00000100:00100000:3.0:1788843299.882243:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788843299.882253:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+12:14402:x1875737795713792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843299.884435:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+12:14402:x1875737795713792:12345-0@lo:501:mount.lustre.0 Request processed in 2166us (3883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843299.884448:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788843299.884558:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795713792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843299.884611:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795713920:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843299.884663:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843299.884702:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795713920 00000100:00100000:1.0:1788843299.884710:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795713920 00000100:00100000:2.0:1788843299.884712:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab50452540 going to sleep for 11 seconds 00000100:00100000:1.0:1788843299.884750:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788843299.884760:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+12:14402:x1875737795713920:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843299.885518:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+12:14402:x1875737795713920:12345-0@lo:503:mount.lustre.0 Request processed in 758us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843299.885527:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788843299.887174:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795713920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843299.888509:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c181180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:845ba2f4-9198-464f-ba29-11072ff30647:14450:1875737795714048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843299.888583:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843299.888629:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab43774cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843299.889475:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795714048 00000100:00100000:2.0:1788843299.889484:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795714048 00000100:00100000:2.0:1788843299.889540:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788843299.889552:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+12:14450:x1875737795714048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843299.889849:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+12:14450:x1875737795714048:12345-0@lo:502:llog_process_th.0 Request processed in 300us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843299.889858:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788843299.890131:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c181180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:845ba2f4-9198-464f-ba29-11072ff30647:14450:1875737795714048:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788843299.890201:0:14450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788843299.890218:0:14450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8dab477dcd28) 00000020:00000080:3.0:1788843299.890242:0:14450:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788843299.890320:0:14450:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dab7c1e8000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788843299.890323:0:14450:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dab7c1e8000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788843299.890325:0:14450:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab7c1e8000 4 00010000:00080000:3.0:1788843299.890380:0:14450:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dab6e2c6800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1788843299.894457:0:14450:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788843299.894696:0:14450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788843299.894744:0:14450:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788843299.894763:0:14450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xc6b8ac1b0915da1 00000100:00080000:2.0:1788843299.894777:0:14450:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788843299.894786:0:14450:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dab6e2c6800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1788843299.894894:0:14450:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab73ff9c00 x1875737795714176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843299.894921:0:14450:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788843299.895046:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875737795714176:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788843299.895327:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843299.895909:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795714176 00000100:00100000:2.0:1788843299.895917:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795714176 00000100:00100000:2.0:1788843299.895951:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843299.895959:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875737795714176:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788843299.896115:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875737795714176:12345-0@lo:38:llog_process_th.0 Request processed in 154us (787us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788843299.896123:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843299.896202:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788843299.896211:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab6e2c6800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843299.896215:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788843299.896219:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875737795714176:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788843299.896240:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:845ba2f4-9198-464f-ba29-11072ff30647:14450:1875737795714304:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788843299.896296:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843299.896322:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab504523c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843299.896324:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795714304 00000100:00100000:3.0:1788843299.896331:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795714304 00000100:00100000:3.0:1788843299.896427:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788843299.896437:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+12:14450:x1875737795714304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788843299.896688:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+12:14450:x1875737795714304:12345-0@lo:502:llog_process_th.0 Request processed in 253us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843299.896696:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788843299.896738:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:845ba2f4-9198-464f-ba29-11072ff30647:14450:1875737795714304:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788843299.896759:0:14450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788843299.897322:0:14402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788843299.897434:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788843299.897488:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933be00/0xc6b8ac1b0915d8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915d93 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843299.897500:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933be00/0xc6b8ac1b0915d8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915d93 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788843299.897550:0:14402:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788843299.897552:0:14402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788843299.897554:0:14402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843299.897555:0:14402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843299.897557:0:14402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843299.897559:0:14402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843299.897561:0:14402:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788843299.897563:0:14402:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788843299.897565:0:14402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843299.897566:0:14402:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788843299.897570:0:14402:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788843299.897573:0:14402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788843299.897574:0:14402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788843299.897576:0:14402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843299.897577:0:14402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843299.897578:0:14402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843299.897579:0:14402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843299.897580:0:14402:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788843299.897582:0:14402:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788843299.897583:0:14402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843299.897584:0:14402:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788843299.897614:0:14402:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788843299.897629:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795714432:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788843299.897691:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843299.897724:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4552acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843299.897747:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795714432 00000100:00100000:2.0:1788843299.897752:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795714432 00000100:00100000:2.0:1788843299.897790:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788843299.897899:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+12:14402:x1875737795714432:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788843299.897926:0:14415:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788843299.897941:0:14415:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788843299.949022:0:14415:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788843299.949045:0:14415:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788843299.949154:0:14436:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788843299.949160:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788843299.949186:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915da8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.949205:0:14436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab49374c00/0xc6b8ac1b0915d77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915d70 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.949230:0:14436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915da8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.949284:0:14436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab49374c00/0xc6b8ac1b0915d77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0915d70 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.949301:0:14436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab49374c00/0xc6b8ac1b0915d77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0915d70 expref: 12 pid: 14415 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843299.949327:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14436:1875737795714560:0@lo:104: 00000100:00100000:1.0:1788843299.949628:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843299.949679:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4aa8acc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788843299.949761:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795714560 00000100:00100000:0.0:1788843299.949774:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795714560 00000100:00100000:0.0:1788843299.949828:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843299.949849:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:845ba2f4-9198-464f-ba29-11072ff30647+3:14436:x1875737795714560:12345-0@lo:104: 00010000:00010000:0.0:1788843299.949862:0:14403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0915d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0915d77 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843299.949915:0:14403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788843299.949922:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:845ba2f4-9198-464f-ba29-11072ff30647+3:14436:x1875737795714560:12345-0@lo:104: Request processed in 76us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843299.949929:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788843299.950062:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843299.950069:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0915d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0915d77 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.950076:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4200 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:1.0:1788843299.950080:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0915d70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0915d77 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.950089:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0915d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0915d77 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843299.950096:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0915d70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0915d77 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843299.950101:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788843299.950138:0:14409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0915d70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915d77 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.950156:0:14409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843299.950179:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0915d70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915d77 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.950185:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c4200/0xc6b8ac1b0915d70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915d77 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.950203:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843299.950205:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843299.950207:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843299.950230:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795714688:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843299.950261:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843299.952979:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795714688 00000100:00100000:1.0:1788843299.952996:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795714688 00010000:00010000:1.0:1788843299.953034:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab49374c00/0xc6b8ac1b0915d77 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0915d70 expref: 13 pid: 14415 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843299.953069:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843299.953078:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:845ba2f4-9198-464f-ba29-11072ff30647+13:3306:x1875737795714688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843299.953092:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843299.953097:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab49374c00/0xc6b8ac1b0915d77 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0915d70 expref: 13 pid: 14415 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.953110:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab49374c00/0xc6b8ac1b0915d77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0915d70 expref: 13 pid: 14415 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.953131:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915da8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.953154:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915da8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788843299.953169:0:14405:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004009914s 00010000:00010000:1.0:1788843299.953174:0:14405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915da8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.953179:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915da8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.953186:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915da8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.953192:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915da8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.953197:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933a800 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843299.953200:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915da8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.953207:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915da8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.953216:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915da8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.953226:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843299.953293:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:845ba2f4-9198-464f-ba29-11072ff30647+13:3306:x1875737795714688:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (3031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843299.953300:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843299.953381:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795714688:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788843299.953427:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab49374c00/0xc6b8ac1b0915d77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0915d70 expref: 12 pid: 14415 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843299.953440:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14436:1875737795714560:0@lo:104: 00010000:00010000:1.0:1788843299.953452:0:14436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915da8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.953462:0:14436:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915da8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.953467:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915da8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843299.953473:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915da8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843299.963874:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+11:14402:x1875737795714432:12345-0@lo:253:mount.lustre.0 Request processed in 66067us (66174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843299.963889:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788843299.964003:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:14402:1875737795714432:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788843299.964021:0:14402:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788843299.964025:0:14402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788843299.964027:0:14402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788843299.964028:0:14402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843299.964029:0:14402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843299.964031:0:14402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843299.964032:0:14402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843299.964033:0:14402:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788843299.964034:0:14402:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788843299.964036:0:14402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843299.964037:0:14402:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788843299.964053:0:14402:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788843299.980867:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788843299.981040:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788843299.981917:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788843299.982090:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788843299.982728:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788843299.982897:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788843299.984057:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788843299.984222:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788843299.984979:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788843299.985209:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788843299.987255:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788843299.987866:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1788843300.050726:0:14402:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1788843300.051810:0:14402:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788843300.052072:0:14459:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788843300.052077:0:14459:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788843300.053592:0:14460:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788843300.053721:0:14460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1788843300.057948:0:14402:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788843300.058078:0:14402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788843300.058537:0:14402:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788843300.058544:0:14402:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1788843300.058667:0:14402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788843300.060515:0:14460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788843300.060612:0:14460:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788843300.060617:0:14460:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:3.0:1788843300.070081:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788843300.071157:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788843300.071222:0:14402:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788843300.080082:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788843300.095667:0:14402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788843300.165398:0:14402:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788843300.165445:0:14402:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa9b2c14a3988 00100000:10000000:2.0:1788843300.165455:0:14402:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1788843300.166651:0:14402:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788843300.166856:0:14402:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788843300.166869:0:14402:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788843300.166899:0:14402:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788843300.421810:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788843300.936255:0:14455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788843301.449749:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788843301.509829:0:14417:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788843301.509842:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dab7c1e8000 from 6 10000000:01000000:0.0:1788843301.509849:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788843301.509923:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0915daf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843301.509938:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0915daf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843301.509986:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0915daf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843301.510021:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795714816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843301.510119:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843301.510184:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69839d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788843301.512472:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795714816 00000100:00100000:3.0:1788843301.512492:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795714816 00000100:00100000:3.0:1788843301.512593:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788843301.512607:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+11:14417:x1875737795714816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843301.512628:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843301.512657:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915db6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0915daf expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843301.512694:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0915daf expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843301.512708:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915daf expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843301.512719:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799f000, rc 0) 00000100:00100000:3.0:1788843301.512817:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+12:14417:x1875737795714816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 213us (2698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843301.513164:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788843301.514455:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795714816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843301.514493:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0915daf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915db6 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843301.514508:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0915daf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915db6 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843301.514941:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795714944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788843301.515087:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843301.515154:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69839d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788843301.515256:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795714944 00000100:00100000:3.0:1788843301.515264:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795714944 00000100:00100000:3.0:1788843301.515318:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788843301.515328:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+12:14417:x1875737795714944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788843301.515381:0:14415:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788843301.515403:0:14415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788843301.515416:0:14415:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788843301.515511:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+12:14417:x1875737795714944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 182us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843301.515520:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788843301.516185:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795714944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788843301.516245:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788843301.516258:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0915daf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915db6 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843301.516270:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0915daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915db6 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843301.956973:0:14455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788843302.468892:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843303.493247:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843304.516669:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788843305.293699:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843305.293706:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843305.293709:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843305.293712:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843305.293714:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788843305.293717:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788843305.293721:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dab6e2c6800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843305.293732:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dab6e2c6800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1788843305.293753:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab6e6bf100 x1875737795715200/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788843305.293784:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843305.293799:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795715072:0@lo:400:kworker.0 00000100:00100000:1.0:1788843305.295231:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843305.295316:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875737795715200:0@lo:38:kworker.0 00000100:00100000:1.0:1788843305.295374:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843305.295675:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795715072 00000100:00100000:0.0:1788843305.295684:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795715072 00000100:00100000:0.0:1788843305.295735:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788843305.295744:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+12:3306:x1875737795715072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843305.295807:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+12:3306:x1875737795715072:12345-0@lo:400:kworker.0 Request processed in 53us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843305.295815:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788843305.296061:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795715072:0@lo:400:kworker.0 00000100:00100000:3.0:1788843305.298543:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795715200 00000100:00100000:3.0:1788843305.298556:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795715200 00000100:00100000:3.0:1788843305.298602:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788843305.298610:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1875737795715200:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788843305.298638:0:14422:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 429 last 0 00000020:00000080:3.0:1788843305.298673:0:14422:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xc6b8ac1b0915dbd 00000004:00100000:3.0:1788843305.298689:0:14422:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788843305.300192:0:14422:0:(import.c:65:import_set_state_nolock()) ffff8dab6ec51000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788843305.301476:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1875737795715200:12345-0@lo:38:kworker.0 Request processed in 2859us (6094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843305.301490:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788843305.310695:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dab6e6bf100 x1875737795715200/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788843305.310717:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788843305.310726:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788843305.310731:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788843305.310735:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab6e2c6800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788843305.310741:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1875737795715200:0@lo:38:kworker.0 00010000:00010000:1.0:1788843305.550230:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788843306.261198:0:14704:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788843306.567608:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843307.602876:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843308.614408:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843309.383429:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843299/real 1788843299] req@ffff8dab6e6be300 x1875737795712512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843309 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843309.383486:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dab6e6be300 x1875737795712512/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843309 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843309.383539:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843299/real 1788843299] req@ffff8dab6e6bc700 x1875737795712384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843309 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843309.383553:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dab6e6bc700 x1875737795712384/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843309 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788843309.383574:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab48813000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843309.383605:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788843309.383610:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795712512:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788843309.383616:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab50397800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843309.383622:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788843309.383625:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795712384:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788843309.383974:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843309.383979:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788843309.383982:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dab50397800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843309.383987:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 424 00000100:00080000:1.0:1788843309.383993:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788843309.383999:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dab50397800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1788843309.384020:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab6e6bf480 x1875737795715456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788843309.384046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843309.384050:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788843309.384051:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dab48813000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843309.384055:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 424 00000100:00080000:1.0:1788843309.384058:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788843309.384062:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dab48813000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1788843309.384074:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab6e6bc380 x1875737795715584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843309.384152:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795715712:0@lo:400:kworker.0 00000100:00100000:2.0:1788843309.384214:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843309.384273:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843309.384279:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:845ba2f4-9198-464f-ba29-11072ff30647:3305:1875737795715328:0@lo:400:kworker.0 00000100:00100000:2.0:1788843309.384308:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843309.384428:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795715456:0@lo:8:kworker.0 00000400:00000100:3.0:1788843309.384462:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875737795715456 offset 0 length 520: 4 00000100:00100000:3.0:1788843309.384482:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795715584:0@lo:8:kworker.0 00000400:00000100:3.0:1788843309.384498:0:3303:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875737795715584 offset 0 length 520: 4 00000100:00100000:1.0:1788843309.384620:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795715712 00000100:00100000:1.0:1788843309.384628:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795715712 00000100:00100000:1.0:1788843309.384682:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843309.384703:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795715712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843309.384753:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795715712:12345-0@lo:400:kworker.0 Request processed in 52us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843309.384761:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788843309.384880:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dab6e6bea00 x1875737795715712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843309.384893:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795715712:0@lo:400:kworker.0 00000100:00100000:0.0:1788843309.385120:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795715328 00000100:00100000:0.0:1788843309.385125:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795715328 00000100:00100000:0.0:1788843309.385161:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788843309.385169:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+12:3305:x1875737795715328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843309.385215:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+12:3305:x1875737795715328:12345-0@lo:400:kworker.0 Request processed in 47us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843309.385222:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788843309.385319:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:845ba2f4-9198-464f-ba29-11072ff30647:3305:1875737795715328:0@lo:400:kworker.0 00000020:00000080:0.0:1788843309.610468:0:14855:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff07c15c50 20000000:00000080:0.0:1788843309.610486:0:14855:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dab74ff9400 uarg=0000000000000000 20000000:01000000:0.0:1788843309.610521:0:14855:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788843309.610528:0:14855:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788843309.610533:0:14855:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788843309.613556:0:14856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1788843309.613702:0:14855:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788843309.626101:0:14855:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788843309.626206:0:14855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0915dc4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843309.626230:0:14855:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab49375200/0xc6b8ac1b0915d85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915d7e expref: 11 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843309.626239:0:14855:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0915dc4 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843309.626277:0:14855:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab49375200/0xc6b8ac1b0915d85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0915d7e expref: 11 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843309.626309:0:14855:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab49375200/0xc6b8ac1b0915d85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0915d7e expref: 11 pid: 14415 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843309.626323:0:14855:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14855:1875737795715840:0@lo:104: 00000100:00100000:0.0:1788843309.626419:0:14855:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843309.626468:0:14855:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41adab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843309.626906:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795715840 00000100:00100000:1.0:1788843309.626914:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795715840 00000100:00100000:1.0:1788843309.626966:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843309.626976:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:845ba2f4-9198-464f-ba29-11072ff30647+3:14855:x1875737795715840:12345-0@lo:104: 00010000:00010000:1.0:1788843309.626989:0:14404:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0915d7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0915d85 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843309.627050:0:14404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788843309.627056:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:845ba2f4-9198-464f-ba29-11072ff30647+3:14855:x1875737795715840:12345-0@lo:104: Request processed in 82us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843309.627063:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788843309.627084:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843309.627091:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0915d7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0915d85 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843309.627099:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5600 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:1.0:1788843309.627103:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0915d7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0915d85 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843309.627111:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0915d7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0915d85 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788843309.627118:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0915d7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0915d85 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843309.627124:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788843309.627152:0:14409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0915d7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915d85 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843309.627170:0:14409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788843309.627193:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0915d7e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915d85 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843309.627199:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c5600/0xc6b8ac1b0915d7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915d85 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843309.627269:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843309.627272:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843309.627275:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843309.627295:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795715968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843309.627330:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843309.627425:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795715968 00000100:00100000:2.0:1788843309.627429:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795715968 00010000:00010000:2.0:1788843309.627449:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab49375200/0xc6b8ac1b0915d85 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0915d7e expref: 12 pid: 14415 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843309.627478:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788843309.627491:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:845ba2f4-9198-464f-ba29-11072ff30647+12:3306:x1875737795715968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843309.627502:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843309.627507:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab49375200/0xc6b8ac1b0915d85 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0915d7e expref: 12 pid: 14415 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843309.627517:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab49375200/0xc6b8ac1b0915d85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0915d7e expref: 12 pid: 14415 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843309.627533:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0915dc4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843309.627541:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0915dc4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843309.627553:0:14405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0915dc4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843309.627560:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0915dc4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843309.627566:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0915dc4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843309.627573:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0915dc4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843309.627579:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4c00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843309.627583:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0915dc4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843309.627590:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0915dc4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843309.627604:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0915dc4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843309.627613:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843309.627653:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:845ba2f4-9198-464f-ba29-11072ff30647+12:3306:x1875737795715968:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843309.627661:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843309.627684:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795715968:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843309.627815:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab49375200/0xc6b8ac1b0915d85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0915d7e expref: 11 pid: 14415 timeout: 533 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843309.627825:0:14855:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14855:1875737795715840:0@lo:104: 00010000:00010000:0.0:1788843309.627839:0:14855:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0915dc4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843309.627847:0:14855:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0915dc4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843309.627853:0:14855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0915dc4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843309.627858:0:14855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab821c4c00/0xc6b8ac1b0915dc4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843309.636954:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843310.661652:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788843310.788517:0:14417:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788843310.788528:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab7c1e8000 from 10 10000000:01000000:1.0:1788843310.788535:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788843310.788601:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933b200/0xc6b8ac1b0915dcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843310.788613:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab4933b200/0xc6b8ac1b0915dcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843310.788626:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab4933b200/0xc6b8ac1b0915dcb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843310.788660:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795716096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788843310.788831:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843310.790104:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69839e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788843310.790427:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795716096 00000100:00100000:3.0:1788843310.790440:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795716096 00000100:00100000:3.0:1788843310.790531:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788843310.790544:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab44d6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+11:14417:x1875737795716096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843310.790563:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843310.790589:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7799e800/0xc6b8ac1b0915dd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0915dcb expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843310.790623:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7799e800/0xc6b8ac1b0915dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0915dcb expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843310.790636:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7799e800/0xc6b8ac1b0915dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915dcb expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843310.790647:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799e800, rc 0) 00000100:00100000:3.0:1788843310.790746:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab44d6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+12:14417:x1875737795716096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (1988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843310.790764:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788843310.791594:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795716096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843310.791623:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab4933b200/0xc6b8ac1b0915dcb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915dd2 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843310.791634:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab4933b200/0xc6b8ac1b0915dcb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915dd2 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843310.791725:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795716224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843310.791792:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843310.791830:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69839e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788843310.792007:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795716224 00000100:00100000:2.0:1788843310.792014:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795716224 00000100:00100000:2.0:1788843310.792054:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788843310.792064:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab44d68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+12:14417:x1875737795716224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843310.792449:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab44d68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+12:14417:x1875737795716224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 385us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843310.792467:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843310.794685:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795716224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843310.794779:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795716352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843310.794884:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843310.795716:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69839e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788843310.803046:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795716352 00000100:00100000:0.0:1788843310.803072:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795716352 00000100:00100000:0.0:1788843310.806176:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788843310.806210:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab44d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+12:14417:x1875737795716352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843310.806574:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab44d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+12:14417:x1875737795716352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 380us (11689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843310.806591:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843310.807902:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795716352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788843310.808705:0:14888:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788843310.808787:0:14417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788843310.808816:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788843310.808829:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933b200/0xc6b8ac1b0915dcb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915dd2 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843310.808843:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933b200/0xc6b8ac1b0915dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915dd2 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843311.175936:0:14455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788843311.690066:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843312.708673:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843313.735468:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843314.501863:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:845ba2f4-9198-464f-ba29-11072ff30647:3307:1875737795716480:0@lo:400:kworker.0 00000100:00100000:2.0:1788843314.501946:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843314.502032:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795716480 00000100:00100000:3.0:1788843314.502041:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795716480 00000100:00100000:3.0:1788843314.502092:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788843314.502103:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab44d69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+12:3307:x1875737795716480:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788843314.502292:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843314.502301:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788843314.502303:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843314.502306:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788843314.502465:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795716608:0@lo:400:kworker.0 00000100:00100000:1.0:1788843314.502498:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843314.502538:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795716608 00000100:00100000:1.0:1788843314.502543:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795716608 00000100:00100000:1.0:1788843314.502574:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843314.502581:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795716608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843314.502618:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795716608:12345-0@lo:400:kworker.0 Request processed in 37us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843314.502625:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788843314.502663:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dab6e6bf100 x1875737795716608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843314.502677:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795716608:0@lo:400:kworker.0 00000100:00100000:3.0:1788843314.503493:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab44d69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+12:3307:x1875737795716480:12345-0@lo:400:kworker.0 Request processed in 1388us (1544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843314.503503:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788843314.503589:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:845ba2f4-9198-464f-ba29-11072ff30647:3307:1875737795716480:0@lo:400:kworker.0 00010000:00010000:2.0:1788843314.766933:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788843315.682942:0:15104:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788843315.682948:0:15104:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788843315.683099:0:15104:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dab50469800 00000020:01000004:2.0:1788843315.683122:0:15104:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788843315.683139:0:15104:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788843315.683158:0:15104:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8dab7ffd99b8) 00000020:00000080:2.0:1788843315.683180:0:15104:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788843315.728531:0:15104:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788843315.728793:0:15104:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788843315.734738:0:15104:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788843315.735554:0:15104:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788843315.735822:0:15104:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788843315.736537:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 403: rc = 0 00100000:10000000:3.0:1788843315.736638:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 403: rc = 0 00100000:10000000:3.0:1788843315.736733:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 403: rc = 0 00100000:10000000:3.0:1788843315.737643:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 539: rc = 0 00100000:10000000:3.0:1788843315.738304:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 539: rc = 0 00100000:10000000:3.0:1788843315.738687:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 539: rc = 0 00100000:10000000:3.0:1788843315.739262:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 539: rc = 0 00100000:10000000:3.0:1788843315.739610:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 539: rc = 0 00100000:10000000:3.0:1788843315.739863:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 539: rc = 0 00000020:00000080:3.0:1788843315.740784:0:15104:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788843315.740794:0:15104:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788843315.740805:0:15104:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc6b8ac1b0915de0 00000020:01000004:3.0:1788843315.740814:0:15104:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788843315.740835:0:15104:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788843315.740839:0:15104:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788843315.740845:0:15104:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788843315.740849:0:15104:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788843315.740869:0:15104:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8dab477d99b8) 00000020:00000080:3.0:1788843315.740883:0:15104:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788843315.742200:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843315.742425:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788843315.742431:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788843315.756668:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788843315.756685:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788843315.763300:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788843315.763321:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788843315.765589:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788843315.765797:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788843315.765803:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788843315.769240:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788843315.769255:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:1.0:1788843315.780522:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843315.804440:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788843315.804717:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788843315.804724:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788843315.816533:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788843315.816547:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788843315.817478:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788843315.817487:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788843315.819646:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788843315.821503:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788843315.821511:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788843315.828448:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788843315.828466:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788843315.872828:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788843315.873073:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788843315.873080:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788843315.875633:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788843315.875649:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788843315.876544:0:15104:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788843315.876568:0:15104:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788843315.876574:0:15104:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788843315.891704:0:15104:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788843315.891762:0:15104:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.129@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788843315.891767:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788843315.891768:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788843315.891770:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843315.891771:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843315.891772:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843315.891773:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843315.891775:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788843315.891776:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843315.891777:0:15104:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788843315.891781:0:15104:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788843315.891783:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788843315.891784:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788843315.891786:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843315.891787:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843315.891788:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843315.891789:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843315.891790:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788843315.891791:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843315.891792:0:15104:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788843315.891817:0:15104:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788843315.891835:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795716736:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788843315.891898:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843315.891945:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69916900 going to sleep for 11 seconds 00000100:00100000:2.0:1788843315.892063:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795716736 00000100:00100000:2.0:1788843315.892071:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795716736 00000100:00100000:2.0:1788843315.892125:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788843315.892136:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab44d6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+12:15104:x1875737795716736:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788843315.892164:0:14414:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788843315.892178:0:14414:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788843315.892182:0:14414:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788843315.898265:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab44d6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+12:15104:x1875737795716736:12345-0@lo:253:mount.lustre.0 Request processed in 6123us (6359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843315.898280:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788843315.898451:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795716736:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788843315.898466:0:15104:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788843315.898481:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788843315.898483:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788843315.898485:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788843315.898486:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788843315.898487:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788843315.898488:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788843315.898490:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788843315.898491:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788843315.898492:0:15104:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788843315.898509:0:15104:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dab50469800 from lustre-OST0000 10000000:01000000:0.0:1788843315.898531:0:15104:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1788843315.898533:0:15104:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788843315.898540:0:15104:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dab477db370 local copy 00010000:00010000:0.0:1788843315.898550:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0915cd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915cdd expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843315.898768:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795716864:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843315.898801:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843315.898829:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab699163c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843315.898959:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795716864 00000100:00100000:1.0:1788843315.898966:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795716864 00000100:00100000:1.0:1788843315.899016:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788843315.899024:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab543b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+12:15104:x1875737795716864:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843315.899165:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab543b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+12:15104:x1875737795716864:12345-0@lo:501:mount.lustre.0 Request processed in 141us (363us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788843315.899184:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788843315.899672:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795716864:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788843315.899686:0:15104:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788843315.899848:0:15104:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788843315.899855:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0915cd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915cdd expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843315.899866:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0915cd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915cdd expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843315.899886:0:15104:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dab50469800 10000000:01000000:0.0:1788843315.899890:0:15104:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788843315.899894:0:15104:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8dab477db370 10000000:01000000:0.0:1788843315.899900:0:15104:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788843315.899904:0:15104:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8dab477db370 from 1 10000000:01000000:0.0:1788843315.899907:0:15104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788843315.899931:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0915dee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843315.899938:0:15104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0915dee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843315.899947:0:15104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0915dee lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843315.899961:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795716992:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788843315.899994:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843315.900025:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab699163c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843315.900129:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795716992 00000100:00100000:2.0:1788843315.900134:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795716992 00000100:00100000:2.0:1788843315.900178:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788843315.900185:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab543b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+12:15104:x1875737795716992:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843315.900195:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843315.900208:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab49375200/0xc6b8ac1b0915df5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0915dee expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843315.900228:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab49375200/0xc6b8ac1b0915df5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0915dee expref: 13 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843315.900239:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab49375200/0xc6b8ac1b0915df5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915dee expref: 13 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843315.900260:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375200, rc 0) 00000100:00100000:2.0:1788843315.900323:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab543b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+13:15104:x1875737795716992:12345-0@lo:101:mount.lustre.0 Request processed in 139us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843315.900330:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788843315.900580:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795716992:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843315.900607:0:15104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0915dee lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915df5 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843315.900616:0:15104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0915dee lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915df5 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843315.900630:0:15104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788843315.900648:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0915dee lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915df5 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843315.900656:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c4400/0xc6b8ac1b0915dee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915df5 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843315.900663:0:15104:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788843315.900672:0:15104:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788843315.900676:0:15104:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788843315.900678:0:15104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788843315.900692:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b0915dfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843315.900699:0:15104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b0915dfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843315.900706:0:15104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b0915dfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843315.900718:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795717120:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788843315.900800:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843315.900817:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab699163c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843315.900870:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795717120 00000100:00100000:1.0:1788843315.900874:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795717120 00000100:00100000:1.0:1788843315.900902:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788843315.900908:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab543b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+13:15104:x1875737795717120:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843315.900915:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843315.900924:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab4933a200/0xc6b8ac1b0915e03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0915dfc expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843315.900939:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab4933a200/0xc6b8ac1b0915e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0915dfc expref: 14 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843315.900946:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab4933a200/0xc6b8ac1b0915e03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915dfc expref: 14 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843315.900954:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933a200, rc 0) 00000100:00100000:1.0:1788843315.900982:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab543b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+14:15104:x1875737795717120:12345-0@lo:101:mount.lustre.0 Request processed in 74us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843315.900988:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788843315.901062:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795717120:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843315.901072:0:15104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b0915dfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915e03 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843315.901079:0:15104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b0915dfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915e03 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843315.902072:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788843315.903926:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788843315.904199:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788843315.904246:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788843315.904292:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788843315.904577:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788843315.904618:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788843315.904654:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788843315.904800:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788843315.904809:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788843315.904896:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795717248:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843315.904963:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843315.905005:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69916180 going to sleep for 11 seconds 00000100:00100000:1.0:1788843315.905136:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795717248 00000100:00100000:1.0:1788843315.905144:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795717248 00000100:00100000:1.0:1788843315.905196:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788843315.905205:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7d9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+14:15104:x1875737795717248:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843315.905590:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7d9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+14:15104:x1875737795717248:12345-0@lo:501:mount.lustre.0 Request processed in 385us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843315.905603:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788843315.906417:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795717248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843315.906462:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c181180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795717376:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843315.906509:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843315.906544:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab49368c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843315.906694:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795717376 00000100:00100000:0.0:1788843315.906699:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795717376 00000100:00100000:0.0:1788843315.906733:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788843315.906742:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7d9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+14:15104:x1875737795717376:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843315.907580:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7d9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+14:15104:x1875737795717376:12345-0@lo:503:mount.lustre.0 Request processed in 836us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843315.907588:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788843315.907791:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c181180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795717376:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788843315.909666:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788843315.909756:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c181180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795717504:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843315.909824:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843315.909908:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab49368c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788843315.909963:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795717504 00000100:00100000:1.0:1788843315.909970:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795717504 00000100:00100000:1.0:1788843315.910046:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788843315.910056:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7d9bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+14:15104:x1875737795717504:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843315.910372:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7d9bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+14:15104:x1875737795717504:12345-0@lo:502:mount.lustre.0 Request processed in 317us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843315.910380:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788843315.910511:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c181180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795717504:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788843315.911593:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788843315.911656:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788843315.911691:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788843315.912113:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788843315.912158:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788843315.912194:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788843315.912243:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788843315.912278:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788843315.912321:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788843315.914251:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788843315.914326:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788843315.914418:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788843315.914469:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795717632:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788843315.914543:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843315.914694:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69916480 going to sleep for 11 seconds 00000100:00100000:2.0:1788843315.916405:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795717632 00000100:00100000:2.0:1788843315.916416:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795717632 00000100:00100000:2.0:1788843315.916473:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788843315.916484:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7d9bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+14:15104:x1875737795717632:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843315.916730:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7d9bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+14:15104:x1875737795717632:12345-0@lo:502:mount.lustre.0 Request processed in 237us (2177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843315.916739:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788843315.917210:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795717632:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788843315.917328:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788843315.917375:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788843315.918698:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788843315.918706:0:15118:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788843315.918712:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843315.918714:0:15118:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788843315.918719:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788843315.918803:0:15118:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8dab7ffdcd28) 00000020:00000080:2.0:1788843315.918824:0:15118:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788843315.918831:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788843315.918899:0:15118:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dab50469800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788843315.918906:0:15118:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788843315.918913:0:15118:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xc6b8ac1b0915e11 00010000:00010000:3.0:1788843315.925265:0:15118:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1788843315.940858:0:15118:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1788843315.951152:0:15118:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788843315.954836:0:15118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788843315.954849:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843315.954856:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843315.954858:0:15118:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788843315.954862:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788843315.954864:0:15118:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1788843315.954866:0:15118:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788843315.954867:0:15118:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788843315.954868:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788843315.954871:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843315.954872:0:15118:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788843315.954874:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843315.954877:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843315.954878:0:15118:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788843315.954881:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788843315.954883:0:15118:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788843315.954885:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843315.954887:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843315.954889:0:15118:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788843315.954891:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843315.954893:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843315.954894:0:15118:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788843315.954898:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788843315.954979:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843315.954983:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843315.954984:0:15118:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788843315.954987:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788843315.956600:0:15104:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788843315.956632:0:15104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788843315.956648:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b0915dfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915e03 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843315.956660:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c5800/0xc6b8ac1b0915dfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915e03 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843315.956668:0:15104:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab50469800 from 1 10000000:01000000:0.0:1788843315.956671:0:15104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843315.956718:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4e00/0xc6b8ac1b0915e18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843315.956727:0:15104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c4e00/0xc6b8ac1b0915e18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843315.956738:0:15104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c4e00/0xc6b8ac1b0915e18 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843315.956761:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795717760:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788843315.956823:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843315.956859:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69916780 going to sleep for 11 seconds 00000100:00100000:1.0:1788843315.958487:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795717760 00000100:00100000:1.0:1788843315.958499:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795717760 00000100:00100000:1.0:1788843315.958545:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788843315.958555:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7d9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+14:15104:x1875737795717760:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843315.958570:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843315.958585:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915e1f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0915e18 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843315.958611:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915e1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0915e18 expref: 15 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843315.958621:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915e1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915e18 expref: 15 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843315.958629:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933a800, rc 0) 00000100:00100000:1.0:1788843315.958698:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7d9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+15:15104:x1875737795717760:12345-0@lo:101:mount.lustre.0 Request processed in 133us (1863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843315.958706:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788843315.959046:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795717760:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843315.959063:0:15104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c4e00/0xc6b8ac1b0915e18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915e1f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843315.959085:0:15104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4e00/0xc6b8ac1b0915e18 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915e1f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843315.959628:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788843315.960258:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788843315.960511:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788843315.960552:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788843315.960601:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788843315.960608:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788843315.960671:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795717888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843315.960724:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843315.960764:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69916780 going to sleep for 11 seconds 00000100:00100000:1.0:1788843315.963519:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795717888 00000100:00100000:1.0:1788843315.963533:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795717888 00000100:00100000:1.0:1788843315.963592:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788843315.963601:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7d9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+15:15104:x1875737795717888:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843315.963885:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7d9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+15:15104:x1875737795717888:12345-0@lo:501:mount.lustre.0 Request processed in 284us (3160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843315.963893:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788843315.967035:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795717888:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843315.967093:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795718016:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843315.969625:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843315.969727:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69916780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843315.973620:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795718016 00000100:00100000:0.0:1788843315.973630:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795718016 00000100:00100000:0.0:1788843315.973677:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788843315.973685:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7d9b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+15:15104:x1875737795718016:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843315.973908:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7d9b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+15:15104:x1875737795718016:12345-0@lo:503:mount.lustre.0 Request processed in 222us (6740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843315.973915:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788843315.974005:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795718016:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788843315.979772:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788843315.979859:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795718144:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843315.979938:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843315.980034:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab452ec780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843315.981366:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795718144 00000100:00100000:3.0:1788843315.981384:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795718144 00000100:00100000:2.0:1788843315.981478:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788843315.981486:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7d9b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+15:15104:x1875737795718144:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843315.981678:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7d9b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+15:15104:x1875737795718144:12345-0@lo:502:mount.lustre.0 Request processed in 192us (1742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843315.981686:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788843315.981738:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795718144:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843315.981966:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788843315.982014:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788843315.982065:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788843315.982105:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788843315.982150:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788843315.982220:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788843315.982255:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788843315.982302:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788843315.982367:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795718272:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843315.982407:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843315.982437:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795718272 00000100:00100000:2.0:1788843315.982441:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795718272 00000100:00100000:2.0:1788843315.982463:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788843315.982469:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+15:15104:x1875737795718272:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843315.982606:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+15:15104:x1875737795718272:12345-0@lo:502:mount.lustre.0 Request processed in 137us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843315.982613:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788843315.982654:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab452ec780 going to sleep for 11 seconds 00000100:00100000:2.0:1788843315.982667:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795718272:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843315.982751:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788843315.982765:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788843315.996977:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843315.996990:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843315.996992:0:15122:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788843315.997000:0:15122:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dab50469800 00000020:00000080:3.0:1788843315.997002:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788843315.997009:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843315.997011:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843315.997012:0:15122:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788843315.997014:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843315.997016:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843315.997017:0:15122:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788843315.997020:0:15122:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dab50469800 00000020:00000080:3.0:1788843315.997022:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788843315.997080:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843315.997084:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843315.997085:0:15122:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788843315.997087:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788843315.997090:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843315.997091:0:15122:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788843315.997094:0:15122:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dab50469800 00000020:00000080:3.0:1788843315.997096:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788843315.997131:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788843315.997135:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843315.997136:0:15122:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788843315.997139:0:15122:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788843315.999417:0:15104:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788843315.999455:0:15104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843315.999481:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c4e00/0xc6b8ac1b0915e18 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915e1f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843315.999495:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c4e00/0xc6b8ac1b0915e18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915e1f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843315.999552:0:15104:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788843315.999555:0:15104:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dab50469800 10000000:01000000:3.0:1788843315.999558:0:15104:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dab50469800 10000000:01000000:3.0:1788843315.999562:0:15104:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788843315.999567:0:15104:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dab50469800 from 1 10000000:01000000:3.0:1788843315.999570:0:15104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788843315.999607:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7799ec00/0xc6b8ac1b0915e26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843315.999614:0:15104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab7799ec00/0xc6b8ac1b0915e26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843315.999624:0:15104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab7799ec00/0xc6b8ac1b0915e26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843315.999646:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795718400:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788843315.999712:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843315.999751:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab49368240 going to sleep for 11 seconds 00000100:00100000:3.0:1788843316.002723:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795718400 00000100:00100000:3.0:1788843316.002737:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795718400 00000100:00100000:3.0:1788843316.002798:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788843316.002809:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+15:15104:x1875737795718400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843316.002825:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843316.002842:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7799fa00/0xc6b8ac1b0915e2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0915e26 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.002869:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7799fa00/0xc6b8ac1b0915e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0915e26 expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.002895:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7799fa00/0xc6b8ac1b0915e2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915e26 expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.002905:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799fa00, rc 0) 00000100:00100000:3.0:1788843316.002992:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+16:15104:x1875737795718400:12345-0@lo:101:mount.lustre.0 Request processed in 185us (3281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843316.003000:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788843316.003056:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795718400:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843316.003074:0:15104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab7799ec00/0xc6b8ac1b0915e26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915e2d expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.003083:0:15104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab7799ec00/0xc6b8ac1b0915e26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915e2d expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788843316.003918:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788843316.004304:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843316.004618:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788843316.004661:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788843316.004697:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788843316.004739:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788843316.004770:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788843316.004828:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788843316.004858:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788843316.004886:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788843316.004926:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788843316.004963:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788843316.004996:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788843316.005039:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788843316.005072:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788843316.005117:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788843316.005162:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788843316.005195:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788843316.005227:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788843316.005268:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788843316.005299:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788843316.005385:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788843316.005431:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788843316.005482:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788843316.005518:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788843316.005574:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788843316.005612:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788843316.005643:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788843316.005686:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788843316.005716:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788843316.005782:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788843316.005789:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788843316.005875:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795718528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843316.005932:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843316.005979:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab54088000 going to sleep for 11 seconds 00000100:00100000:0.0:1788843316.006246:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795718528 00000100:00100000:0.0:1788843316.006253:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795718528 00000100:00100000:0.0:1788843316.006317:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788843316.006333:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+16:15104:x1875737795718528:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843316.006582:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+16:15104:x1875737795718528:12345-0@lo:501:mount.lustre.0 Request processed in 250us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843316.006590:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788843316.016615:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795718528:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843316.016679:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795718656:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843316.016750:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843316.016797:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab54088000 going to sleep for 11 seconds 00000100:00100000:1.0:1788843316.017404:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795718656 00000100:00100000:1.0:1788843316.019662:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795718656 00000100:00100000:1.0:1788843316.019739:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788843316.019749:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+16:15104:x1875737795718656:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788843316.020051:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+16:15104:x1875737795718656:12345-0@lo:503:mount.lustre.0 Request processed in 303us (3301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843316.020059:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788843316.021531:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795718656:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788843316.025503:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788843316.025593:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795718784:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843316.025692:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843316.025741:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab49368240 going to sleep for 11 seconds 00000100:00100000:1.0:1788843316.025878:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795718784 00000100:00100000:1.0:1788843316.025885:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795718784 00000100:00100000:1.0:1788843316.025934:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788843316.025944:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+16:15104:x1875737795718784:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843316.026224:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+16:15104:x1875737795718784:12345-0@lo:502:mount.lustre.0 Request processed in 280us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843316.026231:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788843316.026299:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795718784:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788843316.026581:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788843316.026630:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788843316.026662:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788843316.026707:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788843316.026747:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788843316.026793:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788843316.026829:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788843316.026865:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788843316.026913:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788843316.026950:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788843316.026984:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788843316.027043:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788843316.027084:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788843316.027120:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788843316.027183:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788843316.027218:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788843316.027262:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788843316.027303:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788843316.027370:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788843316.027400:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788843316.027445:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788843316.027482:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788843316.027515:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788843316.027564:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788843316.027602:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788843316.027636:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788843316.027680:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788843316.027716:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788843316.027750:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788843316.027798:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788843316.027833:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788843316.027868:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788843316.027918:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788843316.027969:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788843316.028006:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788843316.028070:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788843316.028110:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788843316.028147:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788843316.028196:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788843316.028243:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788843316.028281:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795718912:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843316.028372:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843316.028396:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab514a8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843316.029483:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795718912 00000100:00100000:3.0:1788843316.029493:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795718912 00000100:00100000:3.0:1788843316.029539:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788843316.029548:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+16:15104:x1875737795718912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843316.029786:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+16:15104:x1875737795718912:12345-0@lo:502:mount.lustre.0 Request processed in 239us (1413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843316.029794:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788843316.031066:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795718912:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788843316.031261:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788843316.031295:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788843316.044034:0:15126:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788843316.044063:0:15126:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8dab7f7119b8) 00000020:00000080:3.0:1788843316.044086:0:15126:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788843316.044255:0:15126:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dab50469800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788843316.044260:0:15126:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dab50469800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788843316.044262:0:15126:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab50469800 3 00010000:00080000:3.0:1788843316.044303:0:15126:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dab48b91800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.129@tcp at head 00010000:00010000:3.0:1788843316.050690:0:15126:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788843316.050904:0:15126:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788843316.050942:0:15126:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788843316.050955:0:15126:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xc6b8ac1b0915e3b 00000100:00080000:3.0:1788843316.050965:0:15126:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788843316.050972:0:15126:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dab48b91800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1788843316.051007:0:15126:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab7c180380 x1875737795719040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788843316.051029:0:15126:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788843316.051062:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843316.051066:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788843316.051069:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788843316.051078:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788843316.051132:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795719168:0@lo:400:kworker.0 00000100:00100000:3.0:1788843316.051195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843316.052419:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875737795719040:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788843316.052470:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843316.055259:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795719168 00000100:00100000:2.0:1788843316.055272:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795719168 00000100:00100000:2.0:1788843316.055367:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795719040 00000100:00100000:2.0:1788843316.055371:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795719040 00000100:00100000:2.0:1788843316.055388:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843316.055398:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795719168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843316.055491:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795719168:12345-0@lo:400:kworker.0 Request processed in 93us (4294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843316.055498:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843316.055516:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843316.055520:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875737795719040:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788843316.055542:0:14420:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 440 last 0 00000020:00000080:2.0:1788843316.055579:0:14420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xc6b8ac1b0915e42 00000004:00100000:2.0:1788843316.055593:0:14420:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788843316.055622:0:14420:0:(import.c:65:import_set_state_nolock()) ffff8dab441fb800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843316.055663:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1875737795719040:12345-0@lo:38:llog_process_th.0 Request processed in 140us (3191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843316.055670:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788843316.055713:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dab7c180380 x1875737795719040/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843316.055724:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788843316.055731:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788843316.055739:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788843316.055743:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788843316.055745:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab48b91800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788843316.055751:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1875737795719040:0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788843316.058983:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dab7c183800 x1875737795719168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843316.059003:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795719168:0@lo:400:kworker.0 00000040:00080000:0.0:1788843316.059639:0:15126:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788843316.059972:0:15104:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788843316.059999:0:15104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788843316.060022:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7799ec00/0xc6b8ac1b0915e26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915e2d expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843316.060033:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab7799ec00/0xc6b8ac1b0915e26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915e2d expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788843316.060082:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788843316.060084:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788843316.060085:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843316.060087:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843316.060088:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843316.060090:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843316.060091:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788843316.060093:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843316.060094:0:15104:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788843316.060098:0:15104:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788843316.060100:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788843316.060102:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788843316.060103:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788843316.060105:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788843316.060106:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788843316.060107:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788843316.060108:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788843316.060109:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788843316.060109:0:15104:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788843316.060134:0:15104:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788843316.060151:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795719296:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788843316.060300:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843316.060435:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab514a8780 going to sleep for 11 seconds 00000100:00100000:3.0:1788843316.062753:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795719296 00000100:00100000:3.0:1788843316.062768:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795719296 00000100:00100000:3.0:1788843316.062822:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788843316.062833:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+16:15104:x1875737795719296:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788843316.062872:0:14415:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788843316.062887:0:14415:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788843316.123844:0:14415:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788843316.123896:0:14415:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788843316.125911:0:14436:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788843316.125920:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788843316.125944:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dab49375400/0xc6b8ac1b0915e49 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843316.125963:0:14436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915db6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915daf expref: 16 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843316.125971:0:14436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dab49375400/0xc6b8ac1b0915e49 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843316.126014:0:14436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0915daf expref: 16 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843316.126027:0:14436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915db6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0915daf expref: 16 pid: 14414 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843316.126040:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffaa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14436:1875737795719424:0@lo:104: 00000100:00100000:2.0:1788843316.126104:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843316.126163:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6e76bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843316.126294:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795719424 00000100:00100000:3.0:1788843316.126302:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795719424 00000100:00100000:3.0:1788843316.126377:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843316.126387:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:845ba2f4-9198-464f-ba29-11072ff30647+3:14436:x1875737795719424:12345-0@lo:104: 00010000:00010000:3.0:1788843316.126399:0:14403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0915daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0915db6 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.126448:0:14403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788843316.126454:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:845ba2f4-9198-464f-ba29-11072ff30647+3:14436:x1875737795719424:12345-0@lo:104: Request processed in 70us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843316.126460:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788843316.126866:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffaa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14436:1875737795719424:0@lo:104: 00010000:00010000:2.0:1788843316.126886:0:14436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dab49375400/0xc6b8ac1b0915e49 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.127043:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843316.127049:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0915daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0915db6 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.127076:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4000 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843316.127080:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0915daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0915db6 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.127088:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0915daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0915db6 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843316.127094:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0915daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0915db6 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843316.127100:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788843316.127136:0:14409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0915daf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915db6 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.127143:0:14409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843316.127386:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0915daf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915db6 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.127393:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c4000/0xc6b8ac1b0915daf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915db6 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.127410:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843316.127411:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843316.127413:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843316.127467:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795719552:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843316.127508:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843316.127615:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795719552 00000100:00100000:3.0:1788843316.127621:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795719552 00010000:00010000:3.0:1788843316.127641:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915db6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0915daf expref: 17 pid: 14414 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843316.127669:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788843316.127684:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:845ba2f4-9198-464f-ba29-11072ff30647+17:3306:x1875737795719552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843316.127695:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843316.127699:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915db6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0915daf expref: 17 pid: 14414 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.127709:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915db6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0915daf expref: 17 pid: 14414 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.127734:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915db6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0915daf expref: 17 pid: 14414 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.127748:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dab49375400/0xc6b8ac1b0915e49 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.127755:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab49375400/0xc6b8ac1b0915e49 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788843316.127767:0:14406:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004009914s 00010000:00010000:3.0:1788843316.127772:0:14406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab49375400/0xc6b8ac1b0915e49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.127778:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab49375400/0xc6b8ac1b0915e49 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.127784:0:14406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dab49375400/0xc6b8ac1b0915e49 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.127790:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dab49375400/0xc6b8ac1b0915e49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.127795:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375400 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843316.127804:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dab49375400/0xc6b8ac1b0915e49 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.127812:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dab49375400/0xc6b8ac1b0915e49 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.127833:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dab49375400/0xc6b8ac1b0915e49 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843316.127852:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843316.127886:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:845ba2f4-9198-464f-ba29-11072ff30647+16:3306:x1875737795719552:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843316.127893:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788843316.128197:0:14436:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dab49375400/0xc6b8ac1b0915e49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843316.128206:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dab49375400/0xc6b8ac1b0915e49 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843316.128221:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab49375400/0xc6b8ac1b0915e49 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843316.128563:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c183800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795719552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788843316.142660:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+15:15104:x1875737795719296:12345-0@lo:253:mount.lustre.0 Request processed in 79820us (82350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843316.142686:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788843316.142868:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15104:1875737795719296:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788843316.142893:0:15104:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788843316.142896:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788843316.142898:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788843316.142899:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843316.142900:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843316.142901:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843316.142902:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843316.142904:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843316.142906:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843316.142907:0:15104:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788843316.142923:0:15104:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788843316.150109:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788843316.150584:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788843316.150821:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788843316.150979:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788843316.151127:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788843316.151599:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788843316.152870:0:15104:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788843316.239627:0:15104:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788843316.239637:0:15104:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788843316.239675:0:15104:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788843316.239750:0:15104:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788843316.239765:0:15104:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788843316.239795:0:15104:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788843316.817108:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788843317.828440:0:14417:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788843317.828448:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dab7c1e8000 from 7 10000000:01000000:0.0:1788843317.828452:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788843317.828509:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0915e50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843317.828520:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0915e50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843317.828545:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0915e50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843317.828575:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795719680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788843317.828668:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843317.828714:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafdb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788843317.828998:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795719680 00000100:00100000:1.0:1788843317.829007:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795719680 00000100:00100000:1.0:1788843317.829062:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788843317.829071:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+15:14417:x1875737795719680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843317.829085:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843317.829099:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0915e57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0915e50 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843317.829120:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0915e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0915e50 expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843317.829130:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0915e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915e50 expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843317.829138:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933a600, rc 0) 00000100:00100000:1.0:1788843317.829183:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+16:14417:x1875737795719680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843317.829188:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788843317.829233:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795719680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843317.829246:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0915e50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915e57 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843317.829255:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0915e50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915e57 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843317.829313:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795719808:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788843317.829373:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843317.829389:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69916900 going to sleep for 11 seconds 00000100:00100000:1.0:1788843317.829403:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795719808 00000100:00100000:1.0:1788843317.829406:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795719808 00000100:00100000:1.0:1788843317.829428:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788843317.829434:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+16:14417:x1875737795719808:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788843317.829447:0:14415:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788843317.829462:0:14415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788843317.829465:0:14415:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788843317.829538:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+16:14417:x1875737795719808:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 102us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843317.829545:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788843317.829575:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795719808:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788843317.829624:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788843317.829630:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0915e50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915e57 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843317.829637:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0915e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915e57 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843317.829872:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843318.852562:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843319.877887:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843320.900465:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788843321.157709:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843321.157715:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788843321.157718:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843321.157722:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788843321.157780:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:845ba2f4-9198-464f-ba29-11072ff30647:3307:1875737795719936:0@lo:400:kworker.0 00000100:00100000:3.0:1788843321.157808:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795720064:0@lo:400:kworker.0 00000100:00100000:0.0:1788843321.157862:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843321.157863:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843321.157920:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788843321.157929:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795720192:0@lo:400:kworker.0 00000100:00100000:3.0:1788843321.157957:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843321.158023:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795720064 00000100:00100000:0.0:1788843321.158032:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795720064 00000100:00100000:0.0:1788843321.158073:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795720192 00000100:00100000:0.0:1788843321.158077:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795720192 00000100:00100000:0.0:1788843321.158108:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843321.158119:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795720064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843321.158172:0:14420:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788843321.158179:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795720064:12345-0@lo:400:kworker.0 Request processed in 60us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843321.158183:0:14420:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788843321.158191:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843321.158212:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788843321.158219:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795720192:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788843321.158380:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab77b7e300 x1875737795720064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843321.158393:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795720064:0@lo:400:kworker.0 00000100:00100000:0.0:1788843321.161440:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795720192:12345-0@lo:400:kworker.0 Request processed in 3211us (3472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843321.161454:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788843321.161877:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab77b7d880 x1875737795720192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843321.161950:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795720192:0@lo:400:kworker.0 00000100:00100000:1.0:1788843321.162529:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795719936 00000100:00100000:1.0:1788843321.162538:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795719936 00000100:00100000:1.0:1788843321.162704:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788843321.162719:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+16:3307:x1875737795719936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843321.162805:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+16:3307:x1875737795719936:12345-0@lo:400:kworker.0 Request processed in 87us (4945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843321.162814:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788843321.162819:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:845ba2f4-9198-464f-ba29-11072ff30647:3307:1875737795719936:0@lo:400:kworker.0 00000100:00080000:1.0:1788843321.162876:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1788843321.413263:0:14455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788843321.925776:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788843322.929792:0:15472:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788843322.948520:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843323.972778:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843324.228459:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843309/real 1788843309] req@ffff8dab6e6bf480 x1875737795715456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843324 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843324.228490:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dab6e6bf480 x1875737795715456/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843324 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843324.228512:0:3303:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788843309/real 1788843309] req@ffff8dab6e6bc380 x1875737795715584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843324 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843324.228523:0:3303:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dab6e6bc380 x1875737795715584/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788843324 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788843324.228540:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab50397800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843324.228549:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788843324.228552:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795715456:0@lo:8:kworker.0 00000100:00080000:0.0:1788843324.228558:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab48813000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843324.228561:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788843324.228564:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795715584:0@lo:8:kworker.0 00000100:00080000:2.0:1788843324.228711:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843324.228716:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788843324.228724:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dab50397800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1788843324.228724:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795720320:0@lo:400:kworker.0 00000100:00080000:2.0:1788843324.228729:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 433 00000100:00080000:2.0:1788843324.228734:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788843324.228740:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dab50397800 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1788843324.228761:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab73ffad80 x1875737795720448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788843324.228775:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843324.228779:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788843324.228781:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dab48813000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843324.228783:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 433 00000100:00080000:2.0:1788843324.228786:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788843324.228789:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dab48813000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1788843324.228799:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab73ffbb80 x1875737795720576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843324.228917:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843324.228962:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788843324.228968:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795720704:0@lo:400:kworker.0 00000100:00100000:0.0:1788843324.228995:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843324.229032:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795720320 00000100:00100000:0.0:1788843324.229038:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795720320 00000100:00100000:0.0:1788843324.229084:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788843324.229099:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+16:3306:x1875737795720320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843324.229188:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795720832:0@lo:400:kworker.0 00000100:00100000:2.0:1788843324.229216:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843324.229222:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+16:3306:x1875737795720320:12345-0@lo:400:kworker.0 Request processed in 49us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843324.229229:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788843324.229248:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795720704 00000100:00100000:2.0:1788843324.229263:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795720704 00000100:00100000:0.0:1788843324.229276:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795720832 00000100:00100000:0.0:1788843324.229279:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795720832 00000100:00100000:2.0:1788843324.229297:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843324.229303:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795720704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843324.229310:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843324.229315:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795720832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843324.229337:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795720704:12345-0@lo:400:kworker.0 Request processed in 33us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843324.229365:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788843324.229367:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795720832:12345-0@lo:400:kworker.0 Request processed in 53us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843324.229373:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788843324.229389:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788843324.229424:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab73ff9f80 x1875737795720832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788843324.229435:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795720832:0@lo:400:kworker.0 00000100:00100000:0.0:1788843324.229454:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795720448:0@lo:8:kworker.0 00000100:00100000:0.0:1788843324.229485:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843324.229671:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795720576:0@lo:8:kworker.0 00000100:00100000:0.0:1788843324.229698:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843324.229736:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795720448 00000100:00100000:2.0:1788843324.229741:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795720448 00000100:00100000:2.0:1788843324.229757:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795720576 00000100:00100000:2.0:1788843324.229767:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795720576 00000100:00100000:2.0:1788843324.229781:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843324.229786:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875737795720448:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788843324.229806:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab73ffb480 x1875737795720704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788843324.229808:0:15105:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 448 last 0 00000100:00100000:0.0:1788843324.229815:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795720704:0@lo:400:kworker.0 00000100:00100000:0.0:1788843324.229824:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795720320:0@lo:400:kworker.0 00000020:00000080:2.0:1788843324.230933:0:15105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b8ac1b0915e5e 00002000:00100000:2.0:1788843324.230952:0:15105:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dab441fa800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113970 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788843324.230957:0:15105:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788843324.230959:0:15105:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788843324.234103:0:15105:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788843324.234214:0:15105:0:(import.c:65:import_set_state_nolock()) ffff8dab441fc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843324.236399:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875737795720448:12345-0@lo:8:kworker.0 Request processed in 6602us (6904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843324.236414:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843324.236448:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788843324.236455:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875737795720576:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788843324.236473:0:15105:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788843324.236527:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875737795720576:12345-0@lo:8:kworker.0 Request processed in 72us (6828us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788843324.236533:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788843324.242981:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab73ffad80 x1875737795720448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788843344 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843324.242997:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788843324.243007:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788843324.243017:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788843324.243791:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788843324.243798:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab50397800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788843324.243869:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788843324.243877:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795720448:0@lo:8:kworker.0 00000100:00080000:1.0:1788843324.243906:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab48813000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788843324.243910:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788843324.243914:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795720576:0@lo:8:kworker.0 00000004:00080000:2.0:1788843324.245581:0:14442:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788843324.245995:0:14442:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 448496652911ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788843324.250142:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795720960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843324.250233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788843324.250292:0:14443:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788843324.250313:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14443:1875737795721088:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788843324.250337:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843324.250392:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795721088 00000100:00100000:0.0:1788843324.250399:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795721088 00000100:00100000:0.0:1788843324.250448:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843324.250458:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14443:x1875737795721088:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788843324.252066:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795720960 00000100:00100000:2.0:1788843324.252076:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795720960 00000100:00100000:2.0:1788843324.252115:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843324.252126:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875737795720960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788843324.252155:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788843324.252235:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875737795720960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843324.252242:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788843324.252657:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1788843324.260276:0:15107:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788843324.260287:0:15107:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1788843324.260292:0:15107:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00010000:00080000:1.0:1788843324.260479:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab77b7ed80 x1875737795720960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843324.260503:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795720960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843324.260537:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41aeb480 going to sleep for 11 seconds 00002000:00010000:0.0:1788843324.280634:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.280649:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915e65 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.280678:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.280685:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.280692:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915e65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.280711:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915e65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.280724:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915e65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.280733:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915e65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.280761:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843324.280775:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843324.280781:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915e65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.280790:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843324.280794:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915e65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.280804:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915e65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.280835:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915e65 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.280843:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915e65 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.280862:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.280864:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.280866:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.281384:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.281391:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915e6c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.281400:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.281411:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.281415:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915e6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.281425:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915e6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.281432:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915e6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.281438:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915e6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.281454:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843324.281463:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843324.281467:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915e6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.281473:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843324.281477:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915e6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.281484:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915e6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.281494:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915e6c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.281512:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915e6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.281527:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.281528:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.281530:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.281915:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.281922:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915e73 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.281931:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.281934:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.281937:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915e73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.281946:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915e73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.281954:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915e73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.281961:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915e73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.281976:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843324.281985:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843324.281995:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915e73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.282002:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4c00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843324.282005:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915e73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.282013:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915e73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.282025:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915e73 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.282032:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915e73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.282045:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.282047:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.282049:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.285928:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.285942:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915e7a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.285958:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.285963:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.285970:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915e7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.285996:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915e7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.286007:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915e7a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.286014:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915e7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.286044:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843324.286056:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843324.286062:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915e7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.286069:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843324.286074:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915e7a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.286084:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915e7a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.286099:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915e7a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.286105:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915e7a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.286129:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.286131:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.286133:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.286619:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.286625:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915e81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.286634:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.286637:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.286641:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915e81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.286650:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915e81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.286658:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915e81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.286665:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915e81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.286680:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843324.286689:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843324.286693:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915e81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.286712:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843324.286715:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915e81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.286723:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915e81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.286735:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915e81 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.286743:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915e81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.286759:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.286761:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.286762:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.287154:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.287160:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915e88 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287169:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.287172:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.287175:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915e88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287183:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915e88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287197:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915e88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287204:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915e88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287218:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843324.287226:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843324.287230:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915e88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287236:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843324.287239:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915e88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287246:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915e88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287269:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915e88 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287277:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915e88 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287292:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.287299:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.287300:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.287701:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.287708:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915e8f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287716:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.287719:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.287723:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915e8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287731:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915e8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287740:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915e8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287747:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915e8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287762:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843324.287769:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843324.287773:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915e8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287780:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843324.287783:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915e8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287803:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915e8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287814:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915e8f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287822:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915e8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.287836:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.287838:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.287840:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.288318:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.288325:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915e96 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.288334:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.288337:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.288361:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915e96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.288372:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915e96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.288380:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915e96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.288394:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915e96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.288411:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843324.288421:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843324.288426:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915e96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.288434:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843324.288437:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915e96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.288446:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915e96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.288458:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915e96 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.288465:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915e96 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.288480:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.288482:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.288484:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.289030:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.289043:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915e9d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.289053:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.289055:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.289060:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915e9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.289070:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915e9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.289079:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915e9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.289087:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915e9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.289104:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843324.289113:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843324.289118:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915e9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.289125:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843324.289128:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915e9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.289136:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915e9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.289154:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915e9d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.289161:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915e9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.289177:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.289179:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.289180:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.293591:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.293604:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ea4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.293633:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.293638:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.293645:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ea4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.293659:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ea4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.293670:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ea4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.293678:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ea4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.293709:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843324.293722:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843324.293727:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ea4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.293746:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055800 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843324.293751:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ea4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.293762:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ea4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.293780:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ea4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.293788:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ea4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.293815:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.293817:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.293819:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.296648:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.296661:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915eab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.296677:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.296686:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.296692:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915eab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.296705:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915eab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.296715:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915eab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.296723:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915eab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.296740:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843324.296753:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843324.296758:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915eab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.296766:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055e00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843324.296771:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915eab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.296780:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915eab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.296796:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915eab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.296814:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915eab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.296834:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.296836:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.296838:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.297388:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.297395:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eb2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.297404:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.297407:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.297411:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.297420:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.297429:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eb2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.297436:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.297460:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843324.297849:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.297860:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915eb9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.297869:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.297873:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.297877:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915eb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.297887:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915eb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.297895:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915eb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.297902:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915eb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.297917:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788843324.297927:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788843324.297931:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.297938:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054e00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843324.297942:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eb2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.297950:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eb2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.297968:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eb2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.297975:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eb2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.297991:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843324.297994:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915eb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.298001:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843324.298004:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915eb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.298011:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915eb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.298019:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915eb9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.298026:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915eb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.298037:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.298039:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.298045:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843324.298761:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.299554:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.299564:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915ec0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.299581:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.299586:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.299591:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915ec0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.299603:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915ec0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.299614:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915ec0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.299621:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915ec0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.299706:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843324.299777:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843324.299783:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915ec0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.299791:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843324.299795:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915ec0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.299814:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915ec0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.299829:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915ec0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.299837:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d51a8a2/0xc6b8ac1b0915ec0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.299858:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.299860:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.299862:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.300918:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.300927:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915ec7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.300938:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.300942:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.300947:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915ec7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.300958:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915ec7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.300967:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915ec7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.300981:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915ec7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.300998:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843324.301474:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843324.301484:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915ec7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.301493:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843324.301498:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915ec7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.301518:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915ec7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.301535:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915ec7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.301543:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a39731dc/0xc6b8ac1b0915ec7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.301564:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843324.301566:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843324.301569:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.301922:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.301930:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915ece lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.301940:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.302004:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.302011:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915ece lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.302023:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915ece lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.302032:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915ece lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.302040:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915ece lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.302057:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843324.302067:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843324.302072:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915ece lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.302085:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843324.302089:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915ece lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.302097:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915ece lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.302109:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915ece lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.302116:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adfc338d/0xc6b8ac1b0915ece lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.302132:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.302134:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.302136:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.303001:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.303009:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915ed5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.303021:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.303024:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.303028:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915ed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.303038:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915ed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.304095:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915ed5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.304109:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915ed5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.304128:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843324.304426:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843324.304433:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915ed5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.304442:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4c00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843324.304447:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915ed5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.304456:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915ed5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.304473:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915ed5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.304493:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f8a9a44/0xc6b8ac1b0915ed5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.304512:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843324.304514:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843324.304516:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.307882:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.307894:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915edc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.307911:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.307915:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.307921:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915edc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.307936:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915edc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.307946:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915edc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.307954:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915edc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.307991:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843324.308137:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843324.308145:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915edc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.308157:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843324.308162:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915edc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.308172:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915edc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.308190:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915edc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.308199:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009905c229/0xc6b8ac1b0915edc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.308222:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843324.308225:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843324.308228:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788843324.308578:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788843324.308651:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.308658:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915ee3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.308668:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.308671:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.308675:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915ee3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.308685:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915ee3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.308692:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915ee3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.308698:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915ee3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.308768:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843324.308774:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915ee3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.308782:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843324.308786:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915ee3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.308794:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915ee3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.308804:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915ee3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843324.308813:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843324.308814:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843324.308949:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.310109:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843324.310118:0:15107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019a76543/0xc6b8ac1b0915ee3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843324.311520:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.311531:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eea lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.311553:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.311558:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.311564:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.311579:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.311590:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.311599:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.311793:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843324.312240:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.312246:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915ef1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.312268:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.312271:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.312276:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915ef1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.312286:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915ef1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.312307:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915ef1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.312314:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915ef1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.313621:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788843324.313625:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843324.313636:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.313648:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054e00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843324.313654:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.313665:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.313687:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eea lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.313695:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001263271b/0xc6b8ac1b0915eea lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.313722:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843324.313725:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915ef1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.313731:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055e00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843324.313733:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915ef1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.313740:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915ef1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.313757:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915ef1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.313764:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0915ef1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.313778:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843324.313780:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843324.313781:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.315057:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.315067:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ef8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.315080:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.315084:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.315090:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.315103:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.315112:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ef8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.315120:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ef8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.315159:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788843324.315210:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843324.315219:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ef8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.315227:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055800 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843324.315231:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ef8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.315241:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ef8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.315266:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ef8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.315274:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c814882d/0xc6b8ac1b0915ef8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.315309:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843324.315313:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843324.315315:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.315631:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.315637:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915eff lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.315646:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.315649:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.315654:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915eff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.315663:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915eff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.315671:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915eff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.315680:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915eff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.315698:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788843324.315950:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843324.315956:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915eff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.316036:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843324.316040:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915eff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.316048:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915eff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.316062:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915eff lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.316070:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053c87067/0xc6b8ac1b0915eff lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843324.316089:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.316096:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915f06 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.316104:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.316112:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.316117:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915f06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.316127:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915f06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.316136:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915f06 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.316143:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915f06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.316151:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843324.316558:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.316564:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915f0d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.316572:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.316575:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.316580:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915f0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.316590:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915f0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.316598:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915f0d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.316611:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915f0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.316620:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788843324.316659:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843324.316665:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915f06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.316684:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843324.316688:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915f06 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.316703:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915f06 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.316716:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915f06 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.316725:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0915f06 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.316742:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843324.316746:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915f0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.316752:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843324.316756:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915f0d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.316765:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915f0d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.316776:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915f0d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.316784:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d1e868b/0xc6b8ac1b0915f0d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.316811:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843324.316814:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843324.316817:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.317058:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.317065:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915f14 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.317073:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.317076:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.317080:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915f14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.317090:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915f14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.317099:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915f14 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.317106:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915f14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.317123:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843324.317132:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843324.317136:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915f14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.317155:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843324.317158:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915f14 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.317166:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915f14 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.317176:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915f14 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.317182:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046a99c3d/0xc6b8ac1b0915f14 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.317197:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.317199:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843324.317200:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843324.319595:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843324.323231:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843324.323242:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b0915f1b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.323271:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=448s v=(0 0) 00010000:00010000:0.0:1788843324.323275:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843324.323281:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b0915f1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.323295:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b0915f1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.323311:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b0915f1b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.323320:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b0915f1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843324.324793:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1788843324.325076:0:15107:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:0.0:1788843324.325172:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14443:x1875737795721088:12345-0@lo:5:osp-pre-0-0.0 Request processed in 74712us (74830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843324.325182:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788843324.325376:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14443:1875737795721088:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788843324.325393:0:14443:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:1.0:1788843324.325440:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14443:1875737795721216:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788843324.325476:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843324.325521:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab603b5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788843324.325891:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795721216 00000100:00100000:0.0:1788843324.325898:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795721216 00000100:00100000:0.0:1788843324.325935:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843324.325944:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14443:x1875737795721216:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788843324.325979:0:15108:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1788843324.326328:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843324.326352:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b0915f1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.326366:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41532200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843324.326372:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b0915f1b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.326385:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b0915f1b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.326424:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b0915f1b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.326432:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f32b4167/0xc6b8ac1b0915f1b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843324.326459:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843324.326461:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843324.326464:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843324.336761:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14443:x1875737795721216:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10811us (11278us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788843324.336774:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843324.336911:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bc700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14443:1875737795721216:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788843324.336937:0:14443:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1788843324.997639:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843326.020825:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788843326.353310:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1788843326.353575:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788843327.045792:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843328.075722:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843329.092719:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843329.349108:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843329.349150:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795721344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843329.349256:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843329.349404:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795721344 00000100:00100000:0.0:1788843329.349414:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795721344 00000100:00100000:0.0:1788843329.349485:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843329.349497:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795721344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843329.349539:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843329.349592:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795721344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843329.349600:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788843329.349627:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843329.349662:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788843329.349687:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795721344:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788843329.358619:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788843329.358628:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788843329.358632:0:8:0:(import.c:65:import_set_state_nolock()) ffff8dab48813000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788843329.358641:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 448 00000100:00080000:1.0:1788843329.358649:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788843329.358658:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dab48813000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:1.0:1788843329.358689:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab6e6bd180 x1875737795721600/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788843329.358746:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788843329.358767:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795721472:0@lo:400:kworker.0 00000100:00100000:1.0:1788843329.358860:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843329.358917:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795721600:0@lo:8:kworker.0 00000100:00100000:1.0:1788843329.358949:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843329.358981:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795721856:0@lo:400:kworker.0 00000100:00100000:1.0:1788843329.359015:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843329.359038:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788843329.359044:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795721728:0@lo:400:kworker.0 00000100:00100000:1.0:1788843329.359065:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843329.359096:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795721472 00000100:00100000:1.0:1788843329.359106:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795721472 00000100:00100000:1.0:1788843329.359164:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788843329.359175:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+16:3306:x1875737795721472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843329.359250:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+16:3306:x1875737795721472:12345-0@lo:400:kworker.0 Request processed in 76us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843329.359258:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788843329.359308:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795721856 00000100:00100000:1.0:1788843329.359312:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795721856 00000100:00100000:1.0:1788843329.359386:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795721728 00000100:00100000:1.0:1788843329.359390:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795721728 00000100:00100000:1.0:1788843329.359409:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843329.359416:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795721856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843329.359455:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795721856:12345-0@lo:400:kworker.0 Request processed in 40us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843329.359461:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788843329.359474:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788843329.359479:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795721728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843329.359505:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795721728:12345-0@lo:400:kworker.0 Request processed in 26us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843329.359512:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788843329.359547:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab6e6bfb80 x1875737795721728/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843329.359562:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795721728:0@lo:400:kworker.0 00010000:00080000:1.0:1788843329.359572:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab6e6bdf80 x1875737795721856/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788843329.359580:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795721856:0@lo:400:kworker.0 00000100:00100000:1.0:1788843329.359612:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795721472:0@lo:400:kworker.0 00000100:00100000:0.0:1788843329.359736:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795721600 00000100:00100000:0.0:1788843329.359741:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795721600 00000100:00100000:0.0:1788843329.359777:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788843329.359783:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1875737795721600:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788843329.359807:0:15107:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:1.0:1788843329.364438:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843329.388893:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1875737795721600:12345-0@lo:8:kworker.0 Request processed in 29092us (29925us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788843329.388911:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788843329.395881:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab48813000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788843329.395905:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788843329.395915:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795721600:0@lo:8:kworker.0 00010000:00010000:3.0:1788843330.119235:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788843330.251694:0:15823:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788843330.251698:0:15823:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788843330.251852:0:15823:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dab441fb000 00000020:01000004:2.0:1788843330.251868:0:15823:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788843330.251881:0:15823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788843330.251894:0:15823:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8dab7ffd8000) 00000020:00000080:2.0:1788843330.251909:0:15823:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788843330.282706:0:15823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788843330.283425:0:15823:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788843330.284674:0:15823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788843330.284908:0:15823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788843330.286124:0:15823:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788843330.286720:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 249: rc = 0 00100000:10000000:3.0:1788843330.286819:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 249: rc = 0 00100000:10000000:3.0:1788843330.286957:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 249: rc = 0 00100000:10000000:3.0:1788843330.287948:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 642: rc = 0 00100000:10000000:3.0:1788843330.288518:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 642: rc = 0 00100000:10000000:3.0:1788843330.288997:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 642: rc = 0 00100000:10000000:3.0:1788843330.290790:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 642: rc = 0 00100000:10000000:3.0:1788843330.291702:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 642: rc = 0 00100000:10000000:3.0:1788843330.292090:0:15823:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 642: rc = 0 00000020:00000080:3.0:1788843330.293575:0:15823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788843330.293588:0:15823:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788843330.293600:0:15823:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc6b8ac1b0915f29 00000020:01000004:3.0:1788843330.293609:0:15823:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788843330.293628:0:15823:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.129@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788843330.293632:0:15823:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.129@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788843330.293637:0:15823:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788843330.293659:0:15823:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788843330.293662:0:15823:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.129@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788843330.305996:0:15823:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.129@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788843330.306034:0:15823:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.129@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788843330.306038:0:15823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788843330.306040:0:15823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788843330.306041:0:15823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843330.306042:0:15823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843330.306043:0:15823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843330.306045:0:15823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843330.306046:0:15823:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843330.306048:0:15823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843330.306049:0:15823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788843330.306053:0:15823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788843330.306055:0:15823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788843330.306063:0:15823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788843330.306064:0:15823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843330.306065:0:15823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843330.306066:0:15823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843330.306067:0:15823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843330.306067:0:15823:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843330.306069:0:15823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843330.306069:0:15823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788843330.306094:0:15823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788843330.306114:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795721984:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788843330.306193:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843330.306422:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab452ec780 going to sleep for 11 seconds 00000100:00100000:0.0:1788843330.306552:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795721984 00000100:00100000:0.0:1788843330.306560:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795721984 00000100:00100000:0.0:1788843330.306648:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788843330.306659:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+16:15823:x1875737795721984:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788843330.306707:0:14413:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788843330.306711:0:14413:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788843330.306715:0:14413:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788843330.317068:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+16:15823:x1875737795721984:12345-0@lo:253:mount.lustre.0 Request processed in 10403us (10867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843330.317082:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788843330.317173:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795721984:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788843330.317188:0:15823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788843330.317191:0:15823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788843330.317193:0:15823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788843330.317194:0:15823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788843330.317195:0:15823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788843330.317197:0:15823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788843330.317198:0:15823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788843330.317199:0:15823:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788843330.317201:0:15823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788843330.317203:0:15823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788843330.317234:0:15823:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dab441fb000 from lustre-OST0001 10000000:01000000:3.0:1788843330.317263:0:15823:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788843330.317266:0:15823:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788843330.317273:0:15823:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dab477db370 local copy 00010000:00010000:3.0:1788843330.317282:0:15823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0915cd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915cdd expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843330.317548:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795722112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843330.317583:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843330.317672:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab452ec780 going to sleep for 11 seconds 00000100:00100000:1.0:1788843330.317763:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795722112 00000100:00100000:1.0:1788843330.317769:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795722112 00000100:00100000:1.0:1788843330.317850:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788843330.317860:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+16:15823:x1875737795722112:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843330.318043:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+16:15823:x1875737795722112:12345-0@lo:501:mount.lustre.0 Request processed in 184us (459us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788843330.318051:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788843330.318111:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795722112:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788843330.318185:0:15823:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.129@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788843330.321910:0:15823:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.129@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788843330.321927:0:15823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0915cd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915cdd expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843330.321940:0:15823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933ba00/0xc6b8ac1b0915cd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915cdd expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843330.321966:0:15823:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dab441fb000 10000000:01000000:3.0:1788843330.321971:0:15823:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788843330.321977:0:15823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788843330.321980:0:15823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788843330.321984:0:15823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788843330.321986:0:15823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788843330.322019:0:15823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7799ee00/0xc6b8ac1b0915f30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843330.322027:0:15823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab7799ee00/0xc6b8ac1b0915f30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843330.322036:0:15823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab7799ee00/0xc6b8ac1b0915f30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843330.322059:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795722240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788843330.322124:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843330.322660:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab452ec780 going to sleep for 11 seconds 00000100:00100000:2.0:1788843330.322783:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795722240 00000100:00100000:2.0:1788843330.322790:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795722240 00000100:00100000:2.0:1788843330.322829:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788843330.322839:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+16:15823:x1875737795722240:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843330.322853:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843330.322870:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab49374000/0xc6b8ac1b0915f37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0915f30 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843330.322894:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab49374000/0xc6b8ac1b0915f37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0915f30 expref: 17 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843330.322903:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab49374000/0xc6b8ac1b0915f37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915f30 expref: 17 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843330.322925:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374000, rc 0) 00000100:00100000:2.0:1788843330.322978:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+17:15823:x1875737795722240:12345-0@lo:101:mount.lustre.0 Request processed in 140us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843330.322984:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788843330.323110:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795722240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788843330.323124:0:15823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab7799ee00/0xc6b8ac1b0915f30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915f37 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843330.323138:0:15823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab7799ee00/0xc6b8ac1b0915f30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915f37 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788843330.323909:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788843330.324792:0:15823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788843330.325028:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788843330.325073:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788843330.325107:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788843330.325151:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788843330.325189:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788843330.325235:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788843330.325298:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788843330.325306:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788843330.330435:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795722368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843330.330505:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843330.330643:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795722368 00000100:00100000:2.0:1788843330.330650:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795722368 00000100:00100000:3.0:1788843330.330794:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab452ecc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843330.331069:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788843330.331081:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+17:15823:x1875737795722368:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843330.331723:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+17:15823:x1875737795722368:12345-0@lo:501:mount.lustre.0 Request processed in 643us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843330.331733:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788843330.331855:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795722368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788843330.331896:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795722496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788843330.331941:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843330.332003:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab452ecc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843330.332043:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795722496 00000100:00100000:0.0:1788843330.332048:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795722496 00000100:00100000:0.0:1788843330.332118:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788843330.332126:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+17:15823:x1875737795722496:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843330.332466:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+17:15823:x1875737795722496:12345-0@lo:503:mount.lustre.0 Request processed in 339us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843330.332473:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788843330.332644:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795722496:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788843330.333424:0:15823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788843330.333491:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795722624:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843330.333537:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843330.334272:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab452ecc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843330.338374:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795722624 00000100:00100000:2.0:1788843330.338467:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795722624 00000100:00100000:2.0:1788843330.339394:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788843330.339407:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+17:15823:x1875737795722624:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843330.339918:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+17:15823:x1875737795722624:12345-0@lo:502:mount.lustre.0 Request processed in 512us (6378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843330.339927:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788843330.340270:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795722624:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843330.342061:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788843330.342145:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788843330.342183:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788843330.342246:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788843330.342284:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788843330.342317:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788843330.342524:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788843330.342562:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788843330.342607:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788843330.342973:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795722752:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843330.343061:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843330.343151:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab452ecc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788843330.343194:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795722752 00000100:00100000:2.0:1788843330.343203:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795722752 00000100:00100000:2.0:1788843330.343878:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788843330.343889:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+17:15823:x1875737795722752:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843330.344122:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e1b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+17:15823:x1875737795722752:12345-0@lo:502:mount.lustre.0 Request processed in 234us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843330.344130:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788843330.344223:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795722752:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788843330.344317:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788843330.344329:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788843330.346377:0:15825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788843330.346389:0:15825:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788843330.346394:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788843330.346397:0:15825:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788843330.346403:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788843330.346418:0:15825:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8dab7f713370) 00000020:00000080:3.0:1788843330.346440:0:15825:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788843330.346471:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788843330.346586:0:15825:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dab441fb000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788843330.346595:0:15825:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788843330.346604:0:15825:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xc6b8ac1b0915f45 00010000:00010000:2.0:1788843330.354497:0:15825:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788843330.354975:0:15825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1788843330.358115:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788843330.359609:0:15825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788843330.359621:0:15825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843330.359696:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843330.359699:0:15825:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788843330.359703:0:15825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843330.359707:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843330.359709:0:15825:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788843330.359712:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788843330.359714:0:15825:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788843330.359717:0:15825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843330.359719:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843330.359720:0:15825:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788843330.359722:0:15825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788843330.359725:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843330.359726:0:15825:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788843330.359729:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788843330.359783:0:15825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788843330.359787:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788843330.359788:0:15825:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788843330.359792:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788843330.361807:0:15823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788843330.361849:0:15823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788843330.361873:0:15823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7799ee00/0xc6b8ac1b0915f30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915f37 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.361886:0:15823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab7799ee00/0xc6b8ac1b0915f30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915f37 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843330.361895:0:15823:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab441fb000 from 1 10000000:01000000:0.0:1788843330.361898:0:15823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788843330.361936:0:15823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b0915f4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.361944:0:15823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b0915f4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.361968:0:15823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b0915f4c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843330.361994:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795722880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788843330.362063:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843330.362102:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41aeb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843330.366305:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795722880 00000100:00100000:1.0:1788843330.366316:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795722880 00000100:00100000:1.0:1788843330.366397:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788843330.366408:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+17:15823:x1875737795722880:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788843330.366424:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843330.366442:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab4933bc00/0xc6b8ac1b0915f53 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0915f4c expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843330.366482:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab4933bc00/0xc6b8ac1b0915f53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0915f4c expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843330.366493:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab4933bc00/0xc6b8ac1b0915f53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915f4c expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843330.366503:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933bc00, rc 0) 00000100:00100000:1.0:1788843330.366573:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e1b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+18:15823:x1875737795722880:12345-0@lo:101:mount.lustre.0 Request processed in 167us (4510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843330.366580:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788843330.366749:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795722880:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788843330.366768:0:15823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b0915f4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915f53 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.366778:0:15823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b0915f4c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915f53 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843330.367291:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788843330.367791:0:15823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788843330.368015:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788843330.368058:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788843330.368120:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788843330.368128:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788843330.368194:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795723008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843330.368260:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843330.368298:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41aeb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843330.371293:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795723008 00000100:00100000:1.0:1788843330.371311:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795723008 00000100:00100000:1.0:1788843330.371397:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788843330.371410:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+18:15823:x1875737795723008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843330.378779:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+18:15823:x1875737795723008:12345-0@lo:501:mount.lustre.0 Request processed in 7364us (10510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843330.378793:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788843330.379469:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795723008:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788843330.379856:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795723136:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788843330.379939:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843330.379975:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8daa41aeb3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843330.382513:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795723136 00000100:00100000:2.0:1788843330.382528:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795723136 00000100:00100000:2.0:1788843330.382589:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788843330.382600:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+18:15823:x1875737795723136:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843330.387978:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c202050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+18:15823:x1875737795723136:12345-0@lo:503:mount.lustre.0 Request processed in 5299us (7958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843330.387992:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788843330.391565:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795723136:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788843330.393290:0:15823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788843330.393437:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795723264:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843330.393518:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843330.393562:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab514a8cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843330.398231:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795723264 00000100:00100000:1.0:1788843330.398243:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795723264 00000100:00100000:1.0:1788843330.398306:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788843330.398317:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+18:15823:x1875737795723264:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843330.398641:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c202c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+18:15823:x1875737795723264:12345-0@lo:502:mount.lustre.0 Request processed in 325us (5122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843330.398650:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788843330.398971:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795723264:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843330.400001:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788843330.400068:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788843330.400117:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788843330.400155:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788843330.400189:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788843330.400259:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788843330.400296:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788843330.400332:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788843330.400614:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795723392:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843330.400689:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843330.400731:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab7cd493c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843330.401310:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795723392 00000100:00100000:3.0:1788843330.401320:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795723392 00000100:00100000:3.0:1788843330.401392:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788843330.401402:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+18:15823:x1875737795723392:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788843330.401744:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c201c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+18:15823:x1875737795723392:12345-0@lo:502:mount.lustre.0 Request processed in 343us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843330.401753:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788843330.402047:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795723392:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843330.402182:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788843330.402198:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788843330.416963:0:15829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843330.416976:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843330.416978:0:15829:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788843330.416985:0:15829:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dab441fb000 00000020:00000080:2.0:1788843330.416988:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788843330.416994:0:15829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843330.416997:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843330.416998:0:15829:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788843330.417000:0:15829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843330.417002:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843330.417003:0:15829:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788843330.417006:0:15829:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dab441fb000 00000020:00000080:2.0:1788843330.417008:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788843330.417056:0:15829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843330.418861:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843330.418867:0:15829:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788843330.418875:0:15829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788843330.418881:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843330.418882:0:15829:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788843330.418887:0:15829:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dab441fb000 00000020:00000080:2.0:1788843330.418958:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788843330.427419:0:15829:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788843330.427432:0:15829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788843330.427434:0:15829:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788843330.427439:0:15829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788843330.427509:0:15823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788843330.427535:0:15823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843330.427553:0:15823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b0915f4c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915f53 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843330.427587:0:15823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b0915f4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915f53 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788843330.427632:0:15823:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788843330.427634:0:15823:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dab441fb000 10000000:01000000:2.0:1788843330.427637:0:15823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dab441fb000 10000000:01000000:2.0:1788843330.427641:0:15823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788843330.427645:0:15823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dab441fb000 from 1 10000000:01000000:2.0:1788843330.427648:0:15823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788843330.427682:0:15823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab49374400/0xc6b8ac1b0915f5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843330.427690:0:15823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab49374400/0xc6b8ac1b0915f5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843330.427699:0:15823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab49374400/0xc6b8ac1b0915f5a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843330.427720:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795723520:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788843330.427781:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843330.427816:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4936a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788843330.427835:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795723520 00000100:00100000:2.0:1788843330.427841:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795723520 00000100:00100000:2.0:1788843330.427878:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788843330.427887:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+18:15823:x1875737795723520:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843330.427899:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843330.427911:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab49374600/0xc6b8ac1b0915f61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0915f5a expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843330.427944:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab49374600/0xc6b8ac1b0915f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0915f5a expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843330.427955:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab49374600/0xc6b8ac1b0915f61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915f5a expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843330.427963:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374600, rc 0) 00000100:00100000:2.0:1788843330.428001:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c202450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+19:15823:x1875737795723520:12345-0@lo:101:mount.lustre.0 Request processed in 114us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843330.428007:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788843330.428055:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795723520:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788843330.428067:0:15823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab49374400/0xc6b8ac1b0915f5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915f61 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843330.428076:0:15823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab49374400/0xc6b8ac1b0915f5a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915f61 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843330.428679:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788843330.428946:0:15823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843330.429207:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788843330.435313:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788843330.435369:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788843330.435438:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788843330.435472:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788843330.435510:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788843330.435537:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788843330.435563:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788843330.435599:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788843330.436758:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788843330.436804:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788843330.436852:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788843330.436899:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788843330.436928:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788843330.436968:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788843330.436996:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788843330.437022:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788843330.437071:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788843330.437106:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788843330.437134:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788843330.437170:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788843330.437200:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788843330.437242:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788843330.437282:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788843330.437311:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788843330.437337:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788843330.437397:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788843330.437425:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788843330.437467:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788843330.437507:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788843330.437534:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788843330.437560:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788843330.437585:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788843330.437621:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788843330.439536:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788843330.439606:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788843330.439804:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788843330.439903:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788843330.439911:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788843330.440009:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795723648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843330.440072:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843330.440120:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4936a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788843330.440233:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795723648 00000100:00100000:1.0:1788843330.440239:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795723648 00000100:00100000:1.0:1788843330.440293:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788843330.440304:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+19:15823:x1875737795723648:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788843330.440529:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c200850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+19:15823:x1875737795723648:12345-0@lo:501:mount.lustre.0 Request processed in 226us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843330.440536:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788843330.441494:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795723648:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788843330.441539:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795723776:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843330.441591:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843330.441641:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795723776 00000100:00100000:2.0:1788843330.441647:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795723776 00000100:00100000:2.0:1788843330.441682:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788843330.441690:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+19:15823:x1875737795723776:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788843330.441880:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c201450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+19:15823:x1875737795723776:12345-0@lo:503:mount.lustre.0 Request processed in 190us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843330.441888:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788843330.441935:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4936a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788843330.441948:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795723776:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788843330.442627:0:15823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788843330.442695:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795723904:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843330.442747:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843330.442781:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795723904 00000100:00100000:2.0:1788843330.442785:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795723904 00000100:00100000:2.0:1788843330.442813:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788843330.442820:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+19:15823:x1875737795723904:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843330.443002:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c200c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+19:15823:x1875737795723904:12345-0@lo:502:mount.lustre.0 Request processed in 181us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843330.443009:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788843330.443053:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4936a780 going to sleep for 11 seconds 00000100:00100000:2.0:1788843330.443068:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795723904:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843330.443301:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788843330.443377:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788843330.443415:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788843330.443478:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788843330.443514:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788843330.443563:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788843330.443597:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788843330.443632:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788843330.443679:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788843330.443714:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788843330.443749:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788843330.443798:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788843330.443835:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788843330.443867:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788843330.443909:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788843330.443961:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788843330.443997:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788843330.444044:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788843330.444081:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788843330.444130:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788843330.444193:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788843330.444786:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788843330.444824:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788843330.444875:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788843330.444910:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788843330.444946:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788843330.444997:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788843330.445033:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788843330.445068:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788843330.445114:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788843330.445150:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788843330.445184:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788843330.445242:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788843330.445293:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788843330.445326:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788843330.445616:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788843330.445664:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788843330.445695:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788843330.445741:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788843330.445776:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788843330.445820:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795724032:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788843330.445888:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843330.445930:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4936a780 going to sleep for 11 seconds 00000100:00100000:1.0:1788843330.446788:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795724032 00000100:00100000:1.0:1788843330.446796:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795724032 00000100:00100000:1.0:1788843330.446844:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788843330.446853:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+19:15823:x1875737795724032:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788843330.447085:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c203850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+19:15823:x1875737795724032:12345-0@lo:502:mount.lustre.0 Request processed in 232us (1197us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843330.447093:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788843330.450453:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795724032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788843330.450606:0:15823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788843330.450679:0:15823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788843330.454443:0:15835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788843330.454460:0:15835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8dab440eb370) 00000020:00000080:2.0:1788843330.454484:0:15835:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788843330.454561:0:15835:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dab441fb000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788843330.454566:0:15835:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dab441fb000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788843330.454568:0:15835:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dab441fb000 3 00010000:00080000:2.0:1788843330.454599:0:15835:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dab7f6e3000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.129@tcp at head 00010000:00010000:2.0:1788843330.458252:0:15835:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1788843330.468723:0:15835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788843330.468760:0:15835:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788843330.468771:0:15835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xc6b8ac1b0915f6f 00000100:00080000:2.0:1788843330.468781:0:15835:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788843330.468787:0:15835:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dab7f6e3000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1788843330.468820:0:15835:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab73ff8380 x1875737795724160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843330.468863:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875737795724160:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788843330.468920:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843330.468972:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795724160 00000100:00100000:2.0:1788843330.468978:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795724160 00000100:00100000:2.0:1788843330.469004:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788843330.469010:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1875737795724160:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788843330.469031:0:14420:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:2.0:1788843330.469059:0:14420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xc6b8ac1b0915f76 00000004:00100000:2.0:1788843330.469072:0:14420:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788843330.469098:0:14420:0:(import.c:65:import_set_state_nolock()) ffff8daa4266c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843330.469144:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1875737795724160:12345-0@lo:38:llog_process_th.0 Request processed in 132us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843330.469151:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788843330.469186:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab73ff8380 x1875737795724160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788843340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843330.469196:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788843330.469202:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788843330.469209:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788843330.469225:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788843330.469228:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab7f6e3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788843330.469233:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1875737795724160:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788843330.469249:0:15835:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788843330.469289:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788843330.469294:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788843330.469301:0:8:0:(import.c:65:import_set_state_nolock()) ffff8dab48813000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788843330.469305:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 453 00000100:00080000:2.0:1788843330.469308:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788843330.469313:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dab48813000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:2.0:1788843330.469327:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab73ffad80 x1875737795724416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788843330.469398:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795724288:0@lo:400:kworker.0 00000100:00100000:2.0:1788843330.469441:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843330.469463:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843330.469469:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795724544:0@lo:400:kworker.0 00000100:00100000:2.0:1788843330.469489:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843330.469514:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795724416:0@lo:8:kworker.0 00000100:00100000:2.0:1788843330.469536:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843330.469563:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795724672:0@lo:400:kworker.0 00000100:00100000:2.0:1788843330.469585:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843330.469611:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795724288 00000100:00100000:2.0:1788843330.469614:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795724288 00000100:00100000:2.0:1788843330.469638:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795724416 00000100:00100000:2.0:1788843330.469641:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795724416 00000100:00100000:2.0:1788843330.469652:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843330.469658:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795724288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843330.469697:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795724288:12345-0@lo:400:kworker.0 Request processed in 39us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843330.469704:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788843330.469717:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843330.469721:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875737795724416:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788843330.469762:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875737795724416:12345-0@lo:8:kworker.0 Request processed in 39us (224us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788843330.469767:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843330.469784:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795724544 00000100:00100000:2.0:1788843330.469787:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795724544 00000100:00100000:2.0:1788843330.469807:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795724672 00000100:00100000:2.0:1788843330.469809:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795724672 00000100:00100000:2.0:1788843330.469821:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843330.469827:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795724544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843330.469853:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795724544:12345-0@lo:400:kworker.0 Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843330.469859:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788843330.469869:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843330.469875:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795724672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843330.469901:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1875737795724672:12345-0@lo:400:kworker.0 Request processed in 27us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843330.469906:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788843330.469936:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab73ff9880 x1875737795724544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843330.469945:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795724544:0@lo:400:kworker.0 00000100:00100000:2.0:1788843330.469956:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ff8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795724288:0@lo:400:kworker.0 00000100:00100000:2.0:1788843330.469976:0:3303:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788843330.469980:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab48813000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788843330.469983:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788843330.469986:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795724416:0@lo:8:kworker.0 00010000:00080000:2.0:1788843330.470022:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dab73ffb480 x1875737795724672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788843330.470030:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1875737795724672:0@lo:400:kworker.0 00000040:00080000:2.0:1788843330.475536:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1788843330.475598:0:15823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788843330.475621:0:15823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788843330.475636:0:15823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab49374400/0xc6b8ac1b0915f5a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915f61 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843330.475647:0:15823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab49374400/0xc6b8ac1b0915f5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915f61 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788843330.475689:0:15823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788843330.475691:0:15823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843330.475693:0:15823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843330.475694:0:15823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843330.475695:0:15823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843330.475697:0:15823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843330.475698:0:15823:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843330.475700:0:15823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843330.475701:0:15823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788843330.475704:0:15823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788843330.475707:0:15823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788843330.475708:0:15823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843330.475709:0:15823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843330.475710:0:15823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843330.475711:0:15823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843330.475712:0:15823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843330.475713:0:15823:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843330.475714:0:15823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843330.475715:0:15823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788843330.475738:0:15823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788843330.475757:0:15823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795724800:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788843330.475830:0:15823:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843330.475864:0:15823:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab73b8e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788843330.475892:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795724800 00000100:00100000:2.0:1788843330.475898:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795724800 00000100:00100000:2.0:1788843330.475941:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788843330.475950:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+19:15823:x1875737795724800:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788843330.475986:0:14414:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788843330.475999:0:14414:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788843330.500891:0:14414:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788843330.500904:0:14414:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788843330.500934:0:14436:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788843330.500939:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788843330.500959:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915f7d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843330.500976:0:14436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0915e57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915e50 expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843330.500984:0:14436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915f7d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843330.501019:0:14436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0915e57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0915e50 expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843330.501032:0:14436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0915e57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0915e50 expref: 19 pid: 14413 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843330.501046:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14436:1875737795724928:0@lo:104: 00000100:00100000:3.0:1788843330.501234:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843330.501369:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6eafd900 going to sleep for 11 seconds 00000100:00100000:1.0:1788843330.502951:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795724928 00000100:00100000:1.0:1788843330.502964:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795724928 00000100:00100000:1.0:1788843330.503046:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843330.503057:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:845ba2f4-9198-464f-ba29-11072ff30647+3:14436:x1875737795724928:12345-0@lo:104: 00010000:00010000:1.0:1788843330.503073:0:14404:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0915e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0915e57 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843330.504269:0:14404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788843330.504280:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:845ba2f4-9198-464f-ba29-11072ff30647+3:14436:x1875737795724928:12345-0@lo:104: Request processed in 1223us (3044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843330.504289:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788843330.504360:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843330.504369:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0915e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0915e57 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.504378:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c5e00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:0.0:1788843330.504381:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0915e50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0915e57 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.504391:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0915e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0915e57 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788843330.504397:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0915e50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0915e57 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788843330.504402:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788843330.504448:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0915e50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915e57 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.504454:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788843330.504472:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0915e50 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915e57 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.504478:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c5e00/0xc6b8ac1b0915e50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915e57 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.504494:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843330.504495:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843330.504497:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843330.504997:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:845ba2f4-9198-464f-ba29-11072ff30647:3305:1875737795725056:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843330.505044:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843330.505592:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795725056 00000100:00100000:0.0:1788843330.505599:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795725056 00010000:00010000:0.0:1788843330.505639:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0915e57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0915e50 expref: 20 pid: 14413 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843330.505686:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843330.505695:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:845ba2f4-9198-464f-ba29-11072ff30647+20:3305:x1875737795725056:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788843330.505709:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843330.505715:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0915e57 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0915e50 expref: 20 pid: 14413 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.505727:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0915e57 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0915e50 expref: 20 pid: 14413 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.505745:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915f7d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.505753:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915f7d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788843330.505768:0:14406:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004829773s 00010000:00010000:0.0:1788843330.505772:0:14406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915f7d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.505779:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915f7d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.505786:0:14406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915f7d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.505792:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915f7d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.505797:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799f000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843330.505807:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915f7d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.505815:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915f7d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.505824:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915f7d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843330.505834:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843330.505874:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:845ba2f4-9198-464f-ba29-11072ff30647+20:3305:x1875737795725056:12345-0@lo:103:ldlm_bl.0 Request processed in 180us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843330.505881:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788843330.506377:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:845ba2f4-9198-464f-ba29-11072ff30647:3305:1875737795725056:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788843330.508875:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c201850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+19:15823:x1875737795724800:12345-0@lo:253:mount.lustre.0 Request processed in 32918us (33037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843330.508889:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:3.0:1788843330.508959:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab4933a600/0xc6b8ac1b0915e57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0915e50 expref: 18 pid: 14413 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843330.508990:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14436:1875737795724928:0@lo:104: 00010000:00010000:3.0:1788843330.509012:0:14436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915f7d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843330.509021:0:14436:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915f7d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843330.509027:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915f7d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843330.509033:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0915f7d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843330.509189:0:15823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:845ba2f4-9198-464f-ba29-11072ff30647:15823:1875737795724800:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788843330.509202:0:15823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788843330.509205:0:15823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788843330.509207:0:15823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788843330.509208:0:15823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788843330.509220:0:15823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788843330.509222:0:15823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788843330.509223:0:15823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788843330.509224:0:15823:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788843330.509226:0:15823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788843330.509228:0:15823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788843330.509239:0:15823:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788843330.514464:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788843330.514643:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788843330.514893:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788843330.515038:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788843330.515840:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788843330.516055:0:15823:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788843330.517048:0:15823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788843330.551016:0:15823:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788843330.551025:0:15823:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788843330.551054:0:15823:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788843330.551107:0:15823:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.129@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788843330.551123:0:15823:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788843330.551149:0:15823:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788843331.143523:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788843331.656670:0:14455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788843332.165519:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788843332.228768:0:14417:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788843332.228784:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dab7c1e8000 from 8 10000000:01000000:2.0:1788843332.228790:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788843332.228836:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab49375800/0xc6b8ac1b0915f84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843332.228848:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab49375800/0xc6b8ac1b0915f84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843332.228860:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab49375800/0xc6b8ac1b0915f84 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843332.228884:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73ffb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795725184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788843332.228948:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843332.229003:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab4936ac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788843332.229235:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795725184 00000100:00100000:3.0:1788843332.229245:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795725184 00000100:00100000:3.0:1788843332.229302:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788843332.229313:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+18:14417:x1875737795725184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843332.229327:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843332.229369:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7799fc00/0xc6b8ac1b0915f8b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b0915f84 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843332.229394:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7799fc00/0xc6b8ac1b0915f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b0915f84 expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843332.229419:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7799fc00/0xc6b8ac1b0915f8b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915f84 expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843332.229428:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799fc00, rc 0) 00000100:00100000:3.0:1788843332.229475:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c200450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+19:14417:x1875737795725184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843332.229483:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788843332.229590:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73ffb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795725184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843332.229605:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab49375800/0xc6b8ac1b0915f84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915f8b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843332.229624:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab49375800/0xc6b8ac1b0915f84 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0915f8b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843332.229676:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795725312:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788843332.229713:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843332.229733:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab73b8e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843332.229793:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795725312 00000100:00100000:3.0:1788843332.229798:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795725312 00000100:00100000:3.0:1788843332.229833:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788843332.229841:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+19:14417:x1875737795725312:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788843332.229855:0:14414:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788843332.229872:0:14414:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788843332.229875:0:14414:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788843332.229948:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c203050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+19:14417:x1875737795725312:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 108us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843332.229956:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788843332.230029:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795725312:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788843332.230085:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788843332.230093:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab49375800/0xc6b8ac1b0915f84 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915f8b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843332.230101:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab49375800/0xc6b8ac1b0915f84 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0915f8b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843333.195029:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843334.214726:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843334.468999:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788843334.469030:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795725440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788843334.469135:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843334.470083:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795725440 00000100:00100000:0.0:1788843334.470156:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795725440 00000100:00100000:0.0:1788843334.470250:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843334.470262:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795725440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843334.470313:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843334.471040:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795725440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 776us (1901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843334.471051:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788843334.471090:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843334.472724:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795725440:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788843335.245278:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788843335.496267:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788843335.496277:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788843335.496292:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dab48813000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1788843335.496299:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:0.0:1788843335.496311:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dab48813000 using connection 192.168.203.129@tcp/0@lo 00000100:00100000:3.0:1788843335.496416:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795725568:0@lo:400:kworker.0 00000100:00100000:0.0:1788843335.498263:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dab77b7ca80 x1875737795725824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788843335.498407:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795725696:0@lo:400:kworker.0 00000100:00100000:0.0:1788843335.498493:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843335.498582:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788843335.498589:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795725952:0@lo:400:kworker.0 00000100:00100000:0.0:1788843335.498620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843335.498656:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795725824:0@lo:8:kworker.0 00000100:00100000:0.0:1788843335.498684:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843335.498713:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795726208:0@lo:400:kworker.0 00000100:00100000:0.0:1788843335.498744:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843335.498763:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843335.498769:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795726080:0@lo:400:kworker.0 00000100:00100000:0.0:1788843335.498791:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843335.498823:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795725696 00000100:00100000:0.0:1788843335.498833:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795725696 00000100:00100000:3.0:1788843335.500403:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843335.500511:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795725568 00000100:00100000:3.0:1788843335.500521:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795725568 00000100:00100000:3.0:1788843335.500596:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788843335.500608:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+19:3306:x1875737795725568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843335.500687:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b28c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+19:3306:x1875737795725568:12345-0@lo:400:kworker.0 Request processed in 81us (4197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843335.500712:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788843335.500769:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795725568:0@lo:400:kworker.0 00000100:00100000:0.0:1788843335.502619:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795725824 00000100:00100000:0.0:1788843335.502643:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795725824 00000100:00100000:0.0:1788843335.502710:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843335.502730:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795725696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843335.502862:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795725696:12345-0@lo:400:kworker.0 Request processed in 142us (4369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843335.502871:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843335.502908:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843335.502932:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1875737795725824:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788843335.503077:0:15105:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 459 last 0 00000020:00000080:0.0:1788843335.503120:0:15105:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xc6b8ac1b0915f92 00002000:00100000:0.0:1788843335.503139:0:15105:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8dab6e6e6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113970 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788843335.503144:0:15105:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788843335.503148:0:15105:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1788843335.503290:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795725696:0@lo:400:kworker.0 00002000:00080000:0.0:1788843335.503649:0:15105:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788843335.503682:0:15105:0:(import.c:65:import_set_state_nolock()) ffff8dab6e6e5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843335.503755:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1875737795725824:12345-0@lo:8:kworker.0 Request processed in 821us (5069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843335.503764:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788843335.503806:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795725952 00000100:00100000:0.0:1788843335.503813:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795725952 00000100:00100000:0.0:1788843335.503866:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795726208 00000100:00100000:0.0:1788843335.503871:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795726208 00000100:00100000:3.0:1788843335.503874:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795726080 00000100:00100000:3.0:1788843335.503883:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795726080 00000100:00100000:3.0:1788843335.503938:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788843335.503949:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795725952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843335.504113:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1875737795725952:12345-0@lo:400:kworker.0 Request processed in 164us (5491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843335.504121:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788843335.504140:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788843335.504279:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795726080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843335.504323:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795726080:12345-0@lo:400:kworker.0 Request processed in 177us (5531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843335.504329:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788843335.504393:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab77b7e680 x1875737795726080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843335.504406:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795726080:0@lo:400:kworker.0 00010000:00080000:3.0:1788843335.504436:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab77b7fb80 x1875737795725952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843335.504446:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1875737795725952:0@lo:400:kworker.0 00000100:00100000:0.0:1788843335.504510:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788843335.504526:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795726208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843335.504594:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795726208:12345-0@lo:400:kworker.0 Request processed in 74us (5848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843335.504602:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788843335.504639:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788843335.504674:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab77b7ca80 x1875737795725824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788843360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788843335.504692:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788843335.504702:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788843335.504710:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788843335.504713:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dab48813000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788843335.504756:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788843335.504763:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1875737795725824:0@lo:8:kworker.0 00010000:00080000:3.0:1788843335.504814:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab77b7dc00 x1875737795726208/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788843351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843335.504845:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795726208:0@lo:400:kworker.0 00000100:00100000:2.0:1788843335.505213:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:0.0:1788843335.505235:0:14445:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788843335.505261:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14445:1875737795726464:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788843335.505278:0:14444:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788843335.505313:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843335.505381:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab50452f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788843335.505402:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795726464 00000100:00100000:0.0:1788843335.505409:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795726464 00000100:00100000:0.0:1788843335.505468:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788843335.505479:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14445:x1875737795726464:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788843335.505483:0:15107:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788843335.505495:0:15107:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000004:00080000:1.0:1788843335.506419:0:14444:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 459757073205ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788843335.509368:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795726336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843335.509470:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843335.510451:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795726336 00000100:00100000:0.0:1788843335.510465:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795726336 00000100:00100000:0.0:1788843335.510528:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788843335.510540:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875737795726336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843335.510602:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843335.510694:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1875737795726336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843335.510702:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788843335.510733:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788843335.512675:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dab7ffb0000 x1875737795726336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788843351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788843335.512710:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795726336:0@lo:13:osp-pre-1-0.0 00002000:00080000:0.0:1788843335.515642:0:15105:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788843335.515655:0:15105:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788843335.515662:0:15105:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:0.0:1788843335.532922:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.534119:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2cbeeec/0xc6b8ac1b0915f99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.534145:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.534158:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.534167:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2cbeeec/0xc6b8ac1b0915f99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.534198:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2cbeeec/0xc6b8ac1b0915f99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.534211:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2cbeeec/0xc6b8ac1b0915f99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.534220:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2cbeeec/0xc6b8ac1b0915f99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.534468:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843335.535415:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843335.535430:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2cbeeec/0xc6b8ac1b0915f99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843335.535445:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41533400 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843335.535450:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2cbeeec/0xc6b8ac1b0915f99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843335.535484:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2cbeeec/0xc6b8ac1b0915f99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843335.535512:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2cbeeec/0xc6b8ac1b0915f99 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843335.535520:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2cbeeec/0xc6b8ac1b0915f99 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843335.535544:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843335.535546:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843335.535548:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843335.538399:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.538416:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1ee23cf/0xc6b8ac1b0915fa0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.538437:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.538443:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.538449:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ee23cf/0xc6b8ac1b0915fa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.538467:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1ee23cf/0xc6b8ac1b0915fa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.538478:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1ee23cf/0xc6b8ac1b0915fa0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.538496:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1ee23cf/0xc6b8ac1b0915fa0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.538518:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843335.538535:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843335.538542:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1ee23cf/0xc6b8ac1b0915fa0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.538551:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41533600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843335.538555:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1ee23cf/0xc6b8ac1b0915fa0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.538565:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1ee23cf/0xc6b8ac1b0915fa0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.538583:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1ee23cf/0xc6b8ac1b0915fa0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.541795:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1ee23cf/0xc6b8ac1b0915fa0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.541848:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.541851:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.541854:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843335.545882:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.545907:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073dfb1b0/0xc6b8ac1b0915fa7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.545929:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.545945:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.545953:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073dfb1b0/0xc6b8ac1b0915fa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.545973:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073dfb1b0/0xc6b8ac1b0915fa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.545986:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073dfb1b0/0xc6b8ac1b0915fa7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.545995:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073dfb1b0/0xc6b8ac1b0915fa7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.546028:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843335.546048:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843335.546054:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073dfb1b0/0xc6b8ac1b0915fa7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.546063:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41533200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843335.546069:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073dfb1b0/0xc6b8ac1b0915fa7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.546079:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073dfb1b0/0xc6b8ac1b0915fa7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.546107:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073dfb1b0/0xc6b8ac1b0915fa7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.546115:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073dfb1b0/0xc6b8ac1b0915fa7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.546139:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.546141:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.546143:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843335.547154:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.547166:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc47297d/0xc6b8ac1b0915fae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.547192:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.547196:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.547203:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fc47297d/0xc6b8ac1b0915fae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.547215:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fc47297d/0xc6b8ac1b0915fae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.547224:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fc47297d/0xc6b8ac1b0915fae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.547232:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fc47297d/0xc6b8ac1b0915fae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.547328:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843335.547371:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843335.547377:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fc47297d/0xc6b8ac1b0915fae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.547385:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41533e00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843335.547389:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc47297d/0xc6b8ac1b0915fae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.547397:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fc47297d/0xc6b8ac1b0915fae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.547412:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fc47297d/0xc6b8ac1b0915fae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.547419:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fc47297d/0xc6b8ac1b0915fae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.547438:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.547440:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.547441:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843335.548098:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.548107:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9ce08db/0xc6b8ac1b0915fb5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.548118:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.548127:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.548132:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ce08db/0xc6b8ac1b0915fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.548143:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f9ce08db/0xc6b8ac1b0915fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.548153:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f9ce08db/0xc6b8ac1b0915fb5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.548161:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f9ce08db/0xc6b8ac1b0915fb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.548190:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843335.548202:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843335.548207:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f9ce08db/0xc6b8ac1b0915fb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.548214:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41532400 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843335.548218:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9ce08db/0xc6b8ac1b0915fb5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.548225:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f9ce08db/0xc6b8ac1b0915fb5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.548238:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f9ce08db/0xc6b8ac1b0915fb5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.548258:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f9ce08db/0xc6b8ac1b0915fb5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.548279:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.548281:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.548283:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843335.551720:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.551741:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a01ca13/0xc6b8ac1b0915fbc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.551763:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.551768:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.551776:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a01ca13/0xc6b8ac1b0915fbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.551792:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a01ca13/0xc6b8ac1b0915fbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.551804:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002a01ca13/0xc6b8ac1b0915fbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.552686:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002a01ca13/0xc6b8ac1b0915fbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.552715:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843335.552734:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843335.552748:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002a01ca13/0xc6b8ac1b0915fbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.552757:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41532a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843335.552763:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002a01ca13/0xc6b8ac1b0915fbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.552774:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002a01ca13/0xc6b8ac1b0915fbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.552795:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002a01ca13/0xc6b8ac1b0915fbc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.552801:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a01ca13/0xc6b8ac1b0915fbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.552841:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.552843:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.552844:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843335.553700:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.553712:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdfc63d1/0xc6b8ac1b0915fc3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.553728:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.553732:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.553740:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdfc63d1/0xc6b8ac1b0915fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.553768:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdfc63d1/0xc6b8ac1b0915fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.553780:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdfc63d1/0xc6b8ac1b0915fc3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.553789:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdfc63d1/0xc6b8ac1b0915fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.554373:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843335.554388:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843335.554394:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdfc63d1/0xc6b8ac1b0915fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.554405:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41532e00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843335.554410:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdfc63d1/0xc6b8ac1b0915fc3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.554419:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdfc63d1/0xc6b8ac1b0915fc3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.554436:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdfc63d1/0xc6b8ac1b0915fc3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.554443:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdfc63d1/0xc6b8ac1b0915fc3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.554476:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.554478:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.554479:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843335.556458:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.556472:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.556492:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.556497:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.556504:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.556519:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.556532:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.556541:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.556568:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843335.556585:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843335.559252:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.559287:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40031a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843335.559293:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.559306:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.559332:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.559354:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.559386:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.559388:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.559390:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843335.562743:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.562757:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915fd1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.562777:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.562783:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.562790:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915fd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.562805:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915fd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.562824:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915fd1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.562833:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915fd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.562857:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843335.562874:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843335.562882:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915fd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.562902:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40030400 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843335.562908:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915fd1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.562917:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915fd1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.565044:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915fd1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.565066:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915fd1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.565098:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.565111:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.565114:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843335.567732:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.567745:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c35eb55/0xc6b8ac1b0915fd8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.567767:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.567773:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.567780:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c35eb55/0xc6b8ac1b0915fd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.567797:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c35eb55/0xc6b8ac1b0915fd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.567809:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c35eb55/0xc6b8ac1b0915fd8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.567817:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c35eb55/0xc6b8ac1b0915fd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.567837:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843335.567850:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843335.567856:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c35eb55/0xc6b8ac1b0915fd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.567865:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40031c00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843335.567870:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c35eb55/0xc6b8ac1b0915fd8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.567905:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c35eb55/0xc6b8ac1b0915fd8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.567925:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c35eb55/0xc6b8ac1b0915fd8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788843335.570379:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788843335.570476:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c35eb55/0xc6b8ac1b0915fd8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.570520:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.570523:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.570526:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788843335.571776:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788843335.571790:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004081ca72/0xc6b8ac1b0915fdf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.571810:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788843335.571815:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843335.571823:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004081ca72/0xc6b8ac1b0915fdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.571841:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004081ca72/0xc6b8ac1b0915fdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.571860:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004081ca72/0xc6b8ac1b0915fdf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.571868:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004081ca72/0xc6b8ac1b0915fdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.571900:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843335.572164:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843335.572173:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004081ca72/0xc6b8ac1b0915fdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.572194:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843335.572200:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004081ca72/0xc6b8ac1b0915fdf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.572210:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004081ca72/0xc6b8ac1b0915fdf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.572231:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004081ca72/0xc6b8ac1b0915fdf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.572250:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004081ca72/0xc6b8ac1b0915fdf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.572271:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.572272:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.572274:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788843335.576026:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788843335.576046:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002580bfa4/0xc6b8ac1b0915fe6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.576068:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=459s v=(0 0) 00010000:00010000:2.0:1788843335.576074:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843335.576083:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002580bfa4/0xc6b8ac1b0915fe6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.576100:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002580bfa4/0xc6b8ac1b0915fe6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.576111:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002580bfa4/0xc6b8ac1b0915fe6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.576119:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002580bfa4/0xc6b8ac1b0915fe6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.576155:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788843335.577057:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788843335.577068:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002580bfa4/0xc6b8ac1b0915fe6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.577081:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375e00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843335.577087:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002580bfa4/0xc6b8ac1b0915fe6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.577098:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002580bfa4/0xc6b8ac1b0915fe6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.577120:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002580bfa4/0xc6b8ac1b0915fe6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.577128:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002580bfa4/0xc6b8ac1b0915fe6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.577156:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.577158:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.577160:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843335.578878:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.578905:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fed lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.578927:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.578933:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.579071:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.579088:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.579099:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fed lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.579107:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.579184:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843335.579784:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.579793:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dab299dd/0xc6b8ac1b0915ff4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.579807:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.579810:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.579815:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dab299dd/0xc6b8ac1b0915ff4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.579839:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dab299dd/0xc6b8ac1b0915ff4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.579848:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dab299dd/0xc6b8ac1b0915ff4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.579856:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dab299dd/0xc6b8ac1b0915ff4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.583163:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843335.583190:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.583208:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40031a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843335.583213:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fed lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.583226:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fed lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.583253:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fed lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.583261:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001fcc3402/0xc6b8ac1b0915fed lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.583288:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843335.583292:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dab299dd/0xc6b8ac1b0915ff4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.583300:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40031e00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843335.583303:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dab299dd/0xc6b8ac1b0915ff4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.583330:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dab299dd/0xc6b8ac1b0915ff4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.583365:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dab299dd/0xc6b8ac1b0915ff4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.583376:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843335.583378:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843335.583381:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843335.585660:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.585705:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788843335.585718:0:15105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dab299dd/0xc6b8ac1b0915ff4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843335.586843:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.586854:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915ffb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.586874:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.586879:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.586886:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915ffb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.587469:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915ffb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.587496:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915ffb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.587506:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915ffb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.587574:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843335.588335:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.588380:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067c8f902/0xc6b8ac1b0916002 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.588394:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.588399:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.588406:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067c8f902/0xc6b8ac1b0916002 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.588419:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067c8f902/0xc6b8ac1b0916002 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.588430:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067c8f902/0xc6b8ac1b0916002 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.588438:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067c8f902/0xc6b8ac1b0916002 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.594103:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788843335.594124:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915ffb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.594140:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40030400 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843335.594146:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915ffb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.594159:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915ffb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.594198:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915ffb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.594207:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000477991a3/0xc6b8ac1b0915ffb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.594257:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788843335.594261:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067c8f902/0xc6b8ac1b0916002 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.594268:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40031600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843335.594271:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067c8f902/0xc6b8ac1b0916002 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.594279:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067c8f902/0xc6b8ac1b0916002 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.594289:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067c8f902/0xc6b8ac1b0916002 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843335.594296:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843335.594298:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843335.594300:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.602117:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788843335.602139:0:15105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067c8f902/0xc6b8ac1b0916002 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843335.604090:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.604106:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab0f38d5/0xc6b8ac1b0916009 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.604127:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.604132:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.604140:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0f38d5/0xc6b8ac1b0916009 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.604158:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab0f38d5/0xc6b8ac1b0916009 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.604170:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab0f38d5/0xc6b8ac1b0916009 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.604190:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab0f38d5/0xc6b8ac1b0916009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.611712:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843335.613720:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.613734:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f8a0037/0xc6b8ac1b0916010 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.613763:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.613768:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.613777:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f8a0037/0xc6b8ac1b0916010 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.613795:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f8a0037/0xc6b8ac1b0916010 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.613807:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f8a0037/0xc6b8ac1b0916010 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.613815:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f8a0037/0xc6b8ac1b0916010 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.613915:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843335.613926:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab0f38d5/0xc6b8ac1b0916009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.613947:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40030800 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843335.613952:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab0f38d5/0xc6b8ac1b0916009 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.613963:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab0f38d5/0xc6b8ac1b0916009 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.613987:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab0f38d5/0xc6b8ac1b0916009 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.613995:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab0f38d5/0xc6b8ac1b0916009 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.614020:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843335.614031:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f8a0037/0xc6b8ac1b0916010 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.614038:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40030200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843335.614042:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f8a0037/0xc6b8ac1b0916010 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.614050:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f8a0037/0xc6b8ac1b0916010 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.614061:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f8a0037/0xc6b8ac1b0916010 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.614069:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843335.614071:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843335.614073:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843335.616068:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843335.617614:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788843335.617632:0:15105:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f8a0037/0xc6b8ac1b0916010 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843335.618463:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.618472:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056590725/0xc6b8ac1b0916017 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.618489:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.618494:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.618504:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056590725/0xc6b8ac1b0916017 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.618534:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056590725/0xc6b8ac1b0916017 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.618546:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056590725/0xc6b8ac1b0916017 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.618555:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056590725/0xc6b8ac1b0916017 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.618582:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843335.618980:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.618986:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042348505/0xc6b8ac1b091601e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.618995:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.618999:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.619003:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042348505/0xc6b8ac1b091601e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.619013:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042348505/0xc6b8ac1b091601e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.619021:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042348505/0xc6b8ac1b091601e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.619040:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042348505/0xc6b8ac1b091601e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.619048:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788843335.619490:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.619497:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b2abac6/0xc6b8ac1b0916025 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.619507:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.619511:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.619515:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b2abac6/0xc6b8ac1b0916025 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.619526:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b2abac6/0xc6b8ac1b0916025 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.619535:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b2abac6/0xc6b8ac1b0916025 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.619542:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b2abac6/0xc6b8ac1b0916025 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.619549:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1788843335.619945:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.619951:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ead431f3/0xc6b8ac1b091602c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.619966:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.619969:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.619973:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ead431f3/0xc6b8ac1b091602c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.619982:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ead431f3/0xc6b8ac1b091602c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.619991:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ead431f3/0xc6b8ac1b091602c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.619998:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ead431f3/0xc6b8ac1b091602c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.620007:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:0.0:1788843335.620477:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.620484:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5472e1b/0xc6b8ac1b0916033 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.620494:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.620497:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.620502:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5472e1b/0xc6b8ac1b0916033 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.620512:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5472e1b/0xc6b8ac1b0916033 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.620533:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d5472e1b/0xc6b8ac1b0916033 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.620541:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d5472e1b/0xc6b8ac1b0916033 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.620551:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:0.0:1788843335.620964:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.620970:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ce249c/0xc6b8ac1b091603a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.620980:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.620983:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.620988:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000032ce249c/0xc6b8ac1b091603a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.620998:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000032ce249c/0xc6b8ac1b091603a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.621008:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000032ce249c/0xc6b8ac1b091603a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.621016:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000032ce249c/0xc6b8ac1b091603a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.621037:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:3.0:1788843335.621425:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:3.0:1788843335.621436:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056590725/0xc6b8ac1b0916017 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621446:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40030a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843335.621452:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056590725/0xc6b8ac1b0916017 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621463:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056590725/0xc6b8ac1b0916017 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621484:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056590725/0xc6b8ac1b0916017 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621501:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056590725/0xc6b8ac1b0916017 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621531:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1788843335.621535:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042348505/0xc6b8ac1b091601e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621543:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40030600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843335.621547:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042348505/0xc6b8ac1b091601e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621556:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042348505/0xc6b8ac1b091601e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621567:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042348505/0xc6b8ac1b091601e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621575:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042348505/0xc6b8ac1b091601e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621603:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788843335.621608:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b2abac6/0xc6b8ac1b0916025 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621615:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40031400 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843335.621625:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b2abac6/0xc6b8ac1b0916025 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621634:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b2abac6/0xc6b8ac1b0916025 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621645:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b2abac6/0xc6b8ac1b0916025 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621653:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b2abac6/0xc6b8ac1b0916025 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621668:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788843335.621672:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ead431f3/0xc6b8ac1b091602c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621680:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40031800 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843335.621683:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ead431f3/0xc6b8ac1b091602c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621691:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ead431f3/0xc6b8ac1b091602c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621701:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ead431f3/0xc6b8ac1b091602c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621709:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ead431f3/0xc6b8ac1b091602c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621731:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843335.621736:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d5472e1b/0xc6b8ac1b0916033 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621743:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40030000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843335.621746:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5472e1b/0xc6b8ac1b0916033 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621754:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d5472e1b/0xc6b8ac1b0916033 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621765:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d5472e1b/0xc6b8ac1b0916033 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621773:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5472e1b/0xc6b8ac1b0916033 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621786:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843335.621790:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000032ce249c/0xc6b8ac1b091603a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621796:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab40031000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843335.621800:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ce249c/0xc6b8ac1b091603a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621820:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000032ce249c/0xc6b8ac1b091603a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621832:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000032ce249c/0xc6b8ac1b091603a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621839:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000032ce249c/0xc6b8ac1b091603a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.621854:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843335.621856:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843335.621859:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843335.622055:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843335.624891:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.624906:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074b0c233/0xc6b8ac1b0916041 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.624929:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.625065:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.625074:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074b0c233/0xc6b8ac1b0916041 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.625092:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074b0c233/0xc6b8ac1b0916041 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.625103:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074b0c233/0xc6b8ac1b0916041 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.625112:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074b0c233/0xc6b8ac1b0916041 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.625134:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788843335.625731:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.625738:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad3769c2/0xc6b8ac1b0916048 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.625749:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.625759:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.625764:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ad3769c2/0xc6b8ac1b0916048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.625774:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ad3769c2/0xc6b8ac1b0916048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.625782:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ad3769c2/0xc6b8ac1b0916048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.625789:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ad3769c2/0xc6b8ac1b0916048 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.625815:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1788843335.626307:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.626314:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000255c0feb/0xc6b8ac1b091604f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.626322:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.626325:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.626330:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000255c0feb/0xc6b8ac1b091604f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.626366:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000255c0feb/0xc6b8ac1b091604f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.626375:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000255c0feb/0xc6b8ac1b091604f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.626389:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000255c0feb/0xc6b8ac1b091604f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.626397:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788843335.626737:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788843335.626747:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074b0c233/0xc6b8ac1b0916041 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.626756:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42697400 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843335.626762:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074b0c233/0xc6b8ac1b0916041 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.626772:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074b0c233/0xc6b8ac1b0916041 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.626793:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074b0c233/0xc6b8ac1b0916041 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.626815:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074b0c233/0xc6b8ac1b0916041 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.626838:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843335.626843:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ad3769c2/0xc6b8ac1b0916048 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.626850:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696800 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843335.626853:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad3769c2/0xc6b8ac1b0916048 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.626860:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ad3769c2/0xc6b8ac1b0916048 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.626870:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ad3769c2/0xc6b8ac1b0916048 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.626876:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ad3769c2/0xc6b8ac1b0916048 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.626888:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843335.626892:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000255c0feb/0xc6b8ac1b091604f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.626898:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42697a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843335.626907:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000255c0feb/0xc6b8ac1b091604f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.626914:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000255c0feb/0xc6b8ac1b091604f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.626924:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000255c0feb/0xc6b8ac1b091604f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.626932:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000255c0feb/0xc6b8ac1b091604f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.627018:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843335.627020:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843335.627022:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788843335.627334:0:15105:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788843335.627395:0:15105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000060d21f9/0xc6b8ac1b0916056 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.627407:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=459s v=(0 0) 00010000:00010000:0.0:1788843335.627411:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843335.627415:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000060d21f9/0xc6b8ac1b0916056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.627426:0:15105:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000060d21f9/0xc6b8ac1b0916056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.627435:0:15105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000060d21f9/0xc6b8ac1b0916056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.627443:0:15105:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000060d21f9/0xc6b8ac1b0916056 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843335.627461:0:15105:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788843335.627670:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843335.627674:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000060d21f9/0xc6b8ac1b0916056 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.627680:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42697c00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843335.627683:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000060d21f9/0xc6b8ac1b0916056 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.627688:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000060d21f9/0xc6b8ac1b0916056 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.627697:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000060d21f9/0xc6b8ac1b0916056 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.627708:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000060d21f9/0xc6b8ac1b0916056 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843335.627717:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843335.627719:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843335.627720:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843335.627825:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788843335.628088:0:15105:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1788843335.628236:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14445:x1875737795726464:12345-0@lo:5:osp-pre-1-0.0 Request processed in 122754us (122918us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843335.628254:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788843335.628484:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb1500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14445:1875737795726464:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788843335.628504:0:14445:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:0.0:1788843335.630487:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14445:1875737795726592:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788843335.630569:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843335.630647:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6e76b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788843335.631010:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795726592 00000100:00100000:3.0:1788843335.631020:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795726592 00000100:00100000:3.0:1788843335.631170:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788843335.631193:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14445:x1875737795726592:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788843335.631257:0:15108:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1788843335.643015:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14445:x1875737795726592:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11808us (12428us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788843335.643033:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788843335.643250:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb3800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14445:1875737795726592:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788843335.643273:0:14445:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00100000:0.0:1788843336.150825:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788843336.150854:0:7650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1788843336.261687:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788843337.277768:0:16185:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg329-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788843337.284519:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843338.311775:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788843339.332548:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843339.592452:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795726720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843339.592622:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843339.593140:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795726720 00000100:00100000:1.0:1788843339.593162:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795726720 00000100:00100000:1.0:1788843339.593281:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843339.593294:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795726720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843339.593416:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843339.593496:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795726720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 204us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843339.593504:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843339.593794:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795726720:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788843339.597505:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788843339.675657:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843339.677993:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775809024 00000100:00100000:1.0:1788843339.678019:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775809024 00000100:00100000:1.0:1788843339.678097:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 76 00000100:00100000:1.0:1788843339.678108:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2355:x1875737775809024:12345-192.168.203.29@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788843339.678180:0:14415:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 80593374-1a93-4bf4-84d9-50ccd339dd04@192.168.203.29@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:1.0:1788843339.678224:0:14415:0:(genops.c:1385:class_connect()) connect: client 80593374-1a93-4bf4-84d9-50ccd339dd04, cookie 0xc6b8ac1b091605d 00000100:00080000:1.0:1788843339.678643:0:14415:0:(import.c:65:import_set_state_nolock()) ffff8dab441ff000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788843339.678917:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b29450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+5:2355:x1875737775809024:12345-192.168.203.29@tcp:250:mount.lustre.0 Request processed in 807us (3589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843339.678927:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 76 00000100:00100000:0.0:1788843339.686327:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843339.686452:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775809152 00000100:00100000:3.0:1788843339.686466:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775809152 00000100:00100000:3.0:1788843339.686542:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 77 00000100:00100000:3.0:1788843339.686555:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+5:13759:x1875737775809152:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788843339.686588:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843339.686612:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0916064 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084c07 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843339.686650:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0916064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c07 expref: 6 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843339.686663:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7799f000/0xc6b8ac1b0916064 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c07 expref: 6 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843339.686699:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799f000, rc 0) 00000100:00100000:3.0:1788843339.686933:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b28850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+6:13759:x1875737775809152:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 380us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843339.686942:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 77 00000100:00100000:3.0:1788843339.690816:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843339.691194:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775809280 00000100:00100000:1.0:1788843339.691208:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775809280 00000100:00100000:1.0:1788843339.691286:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 78 00000100:00100000:1.0:1788843339.691297:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+6:13759:x1875737775809280:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788843339.691883:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b2a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+6:13759:x1875737775809280:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 584us (1079us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788843339.691894:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 78 00000100:00100000:0.0:1788843339.697860:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843339.697928:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775809408 00000100:00100000:3.0:1788843339.697941:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775809408 00000100:00100000:3.0:1788843339.698015:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 79 00000100:00100000:3.0:1788843339.698028:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+6:13759:x1875737775809408:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788843339.698049:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843339.698072:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7799e000/0xc6b8ac1b091606b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084c0e expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843339.698109:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7799e000/0xc6b8ac1b091606b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c0e expref: 7 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843339.698123:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7799e000/0xc6b8ac1b091606b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c0e expref: 7 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843339.698135:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799e000, rc 0) 00000100:00100000:3.0:1788843339.698225:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b2ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+7:13759:x1875737775809408:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 199us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843339.698234:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 79 00000100:00100000:0.0:1788843339.708311:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843339.708539:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775809536 00000100:00100000:1.0:1788843339.708553:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775809536 00000100:00100000:1.0:1788843339.708623:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 80 00000100:00100000:1.0:1788843339.708636:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+7:13759:x1875737775809536:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788843339.709030:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b29c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+8:13759:x1875737775809536:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 395us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843339.709040:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 80 00000100:00100000:1.0:1788843339.720887:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843339.720956:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775809664 00000100:00100000:3.0:1788843339.720971:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775809664 00000100:00100000:3.0:1788843339.721046:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00100000:3.0:1788843339.721081:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+8:13759:x1875737775809664:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788843339.721740:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b28050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+8:13759:x1875737775809664:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 650us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843339.721753:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 81 00000100:00100000:2.0:1788843339.724218:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843339.728294:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775809792 00000100:00100000:0.0:1788843339.728317:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775809792 00000100:00100000:0.0:1788843339.728933:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 82 00000100:00100000:0.0:1788843339.728947:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+8:13778:x1875737775809792:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788843339.730006:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b2a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+8:13778:x1875737775809792:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 1054us (5793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843339.730020:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 82 00000100:00100000:0.0:1788843339.761274:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843339.761475:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775809920 00000100:00100000:2.0:1788843339.761490:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775809920 00000100:00100000:2.0:1788843339.761674:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 83 00000100:00100000:2.0:1788843339.761688:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+8:13778:x1875737775809920:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843339.762057:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b2a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+8:13778:x1875737775809920:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 370us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843339.762067:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 83 00000100:00100000:1.0:1788843339.774556:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843339.774741:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775810048 00000100:00100000:0.0:1788843339.774754:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775810048 00000100:00100000:0.0:1788843339.774846:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 84 00000100:00100000:0.0:1788843339.774860:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+8:13759:x1875737775810048:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788843339.774883:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843339.774907:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8daa42697200/0xc6b8ac1b0916072 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084c38 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843339.774945:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8daa42697200/0xc6b8ac1b0916072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c38 expref: 9 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843339.774958:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8daa42697200/0xc6b8ac1b0916072 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c38 expref: 9 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843339.774969:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42697200, rc 0) 00000100:00100000:0.0:1788843339.775051:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b2b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+9:13759:x1875737775810048:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 194us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843339.775059:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 84 00000100:00100000:0.0:1788843339.778564:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843339.778751:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775810176 00000100:00100000:2.0:1788843339.778764:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775810176 00000100:00100000:2.0:1788843339.778909:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:2.0:1788843339.778922:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+9:13759:x1875737775810176:12345-192.168.203.29@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788843339.778956:0:14413:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788843339.778988:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788843339.778993:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788843339.778996:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788843339.778999:0:14413:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788843339.782262:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b2b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+9:13759:x1875737775810176:12345-192.168.203.29@tcp:256:mount.lustre.0 Request processed in 3324us (3694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843339.782284:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 85 00000100:00100000:1.0:1788843339.787109:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843339.790326:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775810304 00000100:00100000:2.0:1788843339.790368:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775810304 00000100:00100000:2.0:1788843339.790455:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 86 00000100:00100000:2.0:1788843339.790466:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+9:13759:x1875737775810304:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788843339.790511:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843339.790542:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab49375600/0xc6b8ac1b0916079 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084c3f expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843339.790595:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab49375600/0xc6b8ac1b0916079 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c3f expref: 10 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843339.790610:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab49375600/0xc6b8ac1b0916079 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c3f expref: 10 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843339.790620:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375600, rc 0) 00000100:00100000:2.0:1788843339.790731:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b29850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+10:13759:x1875737775810304:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 266us (3636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843339.790740:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 86 00000100:00100000:0.0:1788843339.795476:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843339.795591:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775810432 00000100:00100000:1.0:1788843339.795604:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775810432 00000100:00100000:1.0:1788843339.795679:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 87 00000100:00100000:1.0:1788843339.795692:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+10:13759:x1875737775810432:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788843339.796105:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b28450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+10:13759:x1875737775810432:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 413us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843339.796115:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 87 00000100:00100000:3.0:1788843339.798828:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843339.799015:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775810560 00000100:00100000:0.0:1788843339.799029:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775810560 00000100:00100000:0.0:1788843339.799099:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 88 00000100:00100000:0.0:1788843339.799112:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+10:13759:x1875737775810560:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788843339.799686:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b2bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+10:13759:x1875737775810560:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 573us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843339.799694:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 88 00000100:00100000:3.0:1788843339.802748:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843339.805012:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775810688 00000100:00100000:2.0:1788843339.805036:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775810688 00000100:00100000:2.0:1788843339.805122:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 89 00000100:00100000:2.0:1788843339.805136:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+10:13784:x1875737775810688:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843339.805973:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b29050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+10:13784:x1875737775810688:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 832us (3231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843339.805986:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 89 00000100:00100000:2.0:1788843339.819516:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843339.819979:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775810816 00000100:00100000:1.0:1788843339.819994:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775810816 00000100:00100000:1.0:1788843339.820075:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 90 00000100:00100000:1.0:1788843339.820088:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+10:13784:x1875737775810816:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788843339.821472:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b2b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+10:13784:x1875737775810816:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 1374us (1958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843339.821488:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 90 00000100:00100000:3.0:1788843339.836892:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843339.847255:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775810944 00000100:00100000:2.0:1788843339.847278:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775810944 00000100:00100000:2.0:1788843339.847449:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:2.0:1788843339.847461:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2355:x1875737775810944:12345-192.168.203.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788843339.847503:0:14422:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b87c6d43-928f-4231-aaff-6c642a37da7f@192.168.203.29@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:2.0:1788843339.847601:0:14422:0:(genops.c:1385:class_connect()) connect: client b87c6d43-928f-4231-aaff-6c642a37da7f, cookie 0xc6b8ac1b0916080 00000004:00100000:2.0:1788843339.847643:0:14422:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788843339.847651:0:14422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788843339.905380:0:14422:0:(import.c:65:import_set_state_nolock()) ffff8dab6e6e0800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843339.905490:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+6:2355:x1875737775810944:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 58027us (68610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843339.905521:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:1.0:1788843339.911608:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843339.911759:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775811200 00000100:00100000:0.0:1788843339.911772:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775811200 00000100:00100000:0.0:1788843339.911881:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:0.0:1788843339.911894:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+6:13759:x1875737775811200:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788843339.911960:0:14421:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788843339.912089:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+6:13759:x1875737775811200:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 196us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843339.912098:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00080000:2.0:1788843339.912185:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843339.914171:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843339.914274:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775811072 00000100:00100000:3.0:1788843339.914286:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775811072 00000100:00100000:3.0:1788843339.914395:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:3.0:1788843339.914407:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+6:0:x1875737775811072:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788843339.914448:0:14420:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788843339.914537:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+6:0:x1875737775811072:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 132us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843339.914544:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:3.0:1788843339.915098:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843339.915199:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775811328 00000100:00100000:2.0:1788843339.915206:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775811328 00000100:00100000:2.0:1788843339.915255:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1788843339.915264:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+6:13759:x1875737775811328:12345-192.168.203.29@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788843339.915366:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+6:13759:x1875737775811328:12345-192.168.203.29@tcp:40:mount.lustre.0 Request processed in 76us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843339.915376:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:1.0:1788843339.918521:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843339.918668:0:16114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775811456 00000100:00100000:3.0:1788843339.918680:0:16114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775811456 00000100:00100000:3.0:1788843339.918747:0:16114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:3.0:1788843339.918757:0:16114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1875737775811456:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788843339.918800:0:16114:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b87c6d43-928f-4231-aaff-6c642a37da7f@192.168.203.29@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:3.0:1788843339.918855:0:16114:0:(genops.c:1385:class_connect()) connect: client b87c6d43-928f-4231-aaff-6c642a37da7f, cookie 0xc6b8ac1b0916087 00002000:00100000:3.0:1788843339.918875:0:16114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b87c6d43-928f-4231-aaff-6c642a37da7f/ffff8dab77926000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788843339.918889:0:16114:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788843339.919319:0:16114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788843339.919419:0:16114:0:(import.c:65:import_set_state_nolock()) ffff8dab77927800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788843339.919524:0:16114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+6:2355:x1875737775811456:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 765us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843339.919552:0:16114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:3.0:1788843339.922539:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843339.922715:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843339.922879:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775811712 00000100:00100000:1.0:1788843339.922895:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775811712 00000100:00100000:1.0:1788843339.922967:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:1.0:1788843339.922980:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+6:13759:x1875737775811712:12345-192.168.203.29@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788843339.927619:0:14423:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4545us 00000100:00100000:0.0:1788843339.927781:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775811584 00000100:00100000:0.0:1788843339.927794:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775811584 00000100:00100000:0.0:1788843339.927946:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:0.0:1788843339.927958:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2355:x1875737775811584:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788843339.928004:0:15107:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b87c6d43-928f-4231-aaff-6c642a37da7f@192.168.203.29@tcp t0 exp 0000000000000000 cur 464 last 0 00000020:00000080:0.0:1788843339.928047:0:15107:0:(genops.c:1385:class_connect()) connect: client b87c6d43-928f-4231-aaff-6c642a37da7f, cookie 0xc6b8ac1b091608e 00002000:00100000:0.0:1788843339.928064:0:15107:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b87c6d43-928f-4231-aaff-6c642a37da7f/ffff8dab6e6e3800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788843339.928096:0:15107:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788843339.928946:0:15107:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788843339.929004:0:15107:0:(import.c:65:import_set_state_nolock()) ffff8dab6e6e1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788843339.929118:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+6:2355:x1875737775811584:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 1157us (6590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843339.929129:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000004:00200000:0.0:1788843339.942970:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788843339.943169:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+6:13759:x1875737775811712:12345-192.168.203.29@tcp:33:mount.lustre.0 Request processed in 20170us (20432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843339.943190:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:3.0:1788843340.093114:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843340.093232:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775811840 00000100:00100000:2.0:1788843340.093246:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775811840 00000100:00100000:2.0:1788843340.093330:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:2.0:1788843340.093452:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+6:13805:x1875737775811840:12345-192.168.203.29@tcp:101:mkdir.0 00010000:00010000:2.0:1788843340.093483:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843340.093521:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375000/0xc6b8ac1b0916095 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084c69 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843340.093613:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b091609c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843340.093630:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b091609c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843340.093649:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b091609c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843340.093715:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788843340.093720:0:14420:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843340.094514:0:14420:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b091609c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843340.094560:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375000/0xc6b8ac1b0916095 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c69 expref: 8 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843340.094587:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b091609c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c69 expref: 7 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843340.094596:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910200) 00010000:00010000:2.0:1788843340.094600:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843340.094605:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374e00, rc 0) 00000100:00100000:2.0:1788843340.094701:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+7:13805:x1875737775811840:12345-192.168.203.29@tcp:101:mkdir.0 Request processed in 1361us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843340.094711:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00010000:00010000:0.0:1788843340.356874:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843340.612883:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795726976:0@lo:400:kworker.0 00000100:00100000:3.0:1788843340.612977:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843340.613048:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795727488:0@lo:400:kworker.0 00000100:00100000:3.0:1788843340.613076:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843340.613104:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788843340.613110:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:845ba2f4-9198-464f-ba29-11072ff30647:3307:1875737795726848:0@lo:400:kworker.0 00000100:00100000:3.0:1788843340.613156:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843340.613179:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795727360:0@lo:400:kworker.0 00000100:00100000:3.0:1788843340.613203:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843340.613231:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795726976 00000100:00100000:0.0:1788843340.613241:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795726976 00000100:00100000:3.0:1788843340.613245:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795727488 00000100:00100000:3.0:1788843340.613248:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795727488 00000100:00100000:3.0:1788843340.613291:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795727360 00000100:00100000:3.0:1788843340.613294:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795727360 00000100:00100000:0.0:1788843340.613296:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843340.613306:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795726976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843340.613313:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788843340.613318:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795727488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843340.613459:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795727232:0@lo:400:kworker.0 00000100:00100000:2.0:1788843340.613598:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795727104:0@lo:400:kworker.0 00000100:00100000:0.0:1788843340.615985:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795726976:12345-0@lo:400:kworker.0 Request processed in 2662us (2991us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843340.616005:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788843340.616082:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788843340.616101:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795727360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843340.616648:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875737795727360:12345-0@lo:400:kworker.0 Request processed in 553us (3439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843340.616656:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788843340.617258:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1875737795727360:0@lo:400:kworker.0 00000100:00100000:0.0:1788843340.617279:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795726976:0@lo:400:kworker.0 00000100:00080000:0.0:1788843340.617417:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843340.618378:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795726848 00000100:00100000:0.0:1788843340.618392:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795726848 00000100:00100000:0.0:1788843340.618477:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788843340.618487:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab44d6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+19:3307:x1875737795726848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843340.618589:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab44d6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+19:3307:x1875737795726848:12345-0@lo:400:kworker.0 Request processed in 103us (5431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843340.618597:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788843340.618695:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:845ba2f4-9198-464f-ba29-11072ff30647:3307:1875737795726848:0@lo:400:kworker.0 00000100:00100000:3.0:1788843340.622635:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875737795727488:12345-0@lo:400:kworker.0 Request processed in 9301us (9542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843340.622653:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788843340.622668:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1875737795727488:0@lo:400:kworker.0 00000100:00100000:1.0:1788843340.622973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843340.623186:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795727232 00000100:00100000:0.0:1788843340.623196:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795727232 00000100:00100000:0.0:1788843340.623263:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788843340.623273:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795727232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843340.623370:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795727232:12345-0@lo:400:kworker.0 Request processed in 98us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843340.623377:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788843340.623675:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795727232:0@lo:400:kworker.0 00000100:00100000:2.0:1788843340.626980:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843340.627054:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795727616:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843340.627089:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843340.627299:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795727104 00000100:00100000:3.0:1788843340.627311:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795727104 00000100:00100000:3.0:1788843340.627448:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788843340.627460:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795727104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843340.627538:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795727104:12345-0@lo:400:kworker.0 Request processed in 80us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843340.627546:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788843340.627629:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795727616 00000100:00100000:1.0:1788843340.627642:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795727616 00000100:00100000:1.0:1788843340.627679:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843340.627687:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875737795727616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843340.627716:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788843340.627743:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788843340.627757:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1875737795727616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843340.627763:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843340.627765:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795727104:0@lo:400:kworker.0 00000100:00100000:2.0:1788843340.627784:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795727616:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788843340.628082:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1788843341.178848:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b87c6d43-928f-4231-aaff-6c642a37da7f 00010000:00010000:2.0:1788843341.382304:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788843341.696315:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b87c6d43-928f-4231-aaff-6c642a37da7f 00000040:00080000:3.0:1788843341.893071:0:14455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788843342.138754:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843342.138886:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775811968 00000100:00100000:2.0:1788843342.138902:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775811968 00000100:00100000:2.0:1788843342.138997:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:2.0:1788843342.139010:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+7:13857:x1875737775811968:12345-192.168.203.29@tcp:41:lfs.0 00000004:00000024:2.0:1788843342.139074:0:14420:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788843342.139196:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+7:13857:x1875737775811968:12345-192.168.203.29@tcp:41:lfs.0 Request processed in 189us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843342.139205:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00080000:0.0:1788843342.139744:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843342.144017:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843342.144213:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775812096 00000100:00100000:0.0:1788843342.144226:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775812096 00000100:00100000:0.0:1788843342.144326:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:0.0:1788843342.144376:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b87c6d43-928f-4231-aaff-6c642a37da7f+5:13857:x1875737775812096:12345-192.168.203.29@tcp:13:lfs.0 00002000:00000024:0.0:1788843342.144433:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843342.144557:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b87c6d43-928f-4231-aaff-6c642a37da7f+5:13857:x1875737775812096:12345-192.168.203.29@tcp:13:lfs.0 Request processed in 220us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843342.144564:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00080000:2.0:1788843342.145422:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843342.148864:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843342.148981:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775812224 00000100:00100000:0.0:1788843342.148997:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775812224 00000100:00100000:0.0:1788843342.149172:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:0.0:1788843342.149186:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b87c6d43-928f-4231-aaff-6c642a37da7f+5:13857:x1875737775812224:12345-192.168.203.29@tcp:13:lfs.0 00002000:00000024:0.0:1788843342.149264:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843342.149468:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b87c6d43-928f-4231-aaff-6c642a37da7f+5:13857:x1875737775812224:12345-192.168.203.29@tcp:13:lfs.0 Request processed in 284us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843342.149475:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00080000:2.0:1788843342.149641:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788843342.373465:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843342.373616:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775812352 00000100:00100000:1.0:1788843342.373630:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775812352 00000100:00100000:1.0:1788843342.373705:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 92 00000100:00100000:1.0:1788843342.373720:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab44d68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+10:13889:x1875737775812352:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788843342.373752:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843342.373777:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab4933ae00/0xc6b8ac1b09160a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084c70 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843342.373816:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab4933ae00/0xc6b8ac1b09160a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c70 expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843342.373830:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab4933ae00/0xc6b8ac1b09160a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c70 expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843342.373841:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933ae00, rc 0) 00000100:00100000:1.0:1788843342.373925:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab44d68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+11:13889:x1875737775812352:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 207us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843342.373934:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 92 00000100:00100000:3.0:1788843342.389123:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843342.390931:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775812480 00000100:00100000:0.0:1788843342.390950:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775812480 00000100:00100000:0.0:1788843342.392171:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 93 00000100:00100000:0.0:1788843342.392194:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab44d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+11:13889:x1875737775812480:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788843342.395234:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab44d6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+11:13889:x1875737775812480:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 3032us (6109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843342.395251:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 93 00000100:00100000:3.0:1788843342.397943:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843342.398160:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775812608 00000100:00100000:0.0:1788843342.398172:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775812608 00000100:00100000:0.0:1788843342.398299:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 94 00000100:00100000:0.0:1788843342.398311:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab44d69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+11:13889:x1875737775812608:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788843342.398718:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab44d69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+11:13889:x1875737775812608:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 408us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843342.398727:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 94 00010000:00010000:0.0:1788843342.404656:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843342.409569:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843342.409721:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775812736 00000100:00100000:0.0:1788843342.409734:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775812736 00000100:00100000:0.0:1788843342.409915:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 95 00000100:00100000:0.0:1788843342.409928:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab44d6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+11:13896:x1875737775812736:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788843342.411970:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab44d6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+11:13896:x1875737775812736:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 2028us (2402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843342.411987:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 95 00000100:00100000:3.0:1788843342.435836:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843342.436460:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775812864 00000100:00100000:0.0:1788843342.436474:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775812864 00000100:00100000:0.0:1788843342.436569:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 96 00000100:00100000:0.0:1788843342.436582:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab543b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+11:13896:x1875737775812864:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788843342.436971:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab543b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+11:13896:x1875737775812864:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 389us (1148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843342.436981:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 96 00000100:00100000:3.0:1788843342.439859:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843342.440543:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775812992 00000100:00100000:2.0:1788843342.440558:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775812992 00000100:00100000:2.0:1788843342.440641:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 97 00000100:00100000:2.0:1788843342.440653:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab543b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+11:13889:x1875737775812992:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788843342.440676:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843342.440705:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab49375000/0xc6b8ac1b09160aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084c9a expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843342.440750:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab49375000/0xc6b8ac1b09160aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c9a expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843342.440762:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab49375000/0xc6b8ac1b09160aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c9a expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843342.440773:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375000, rc 0) 00000100:00100000:2.0:1788843342.440877:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab543b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+12:13889:x1875737775812992:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 226us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843342.440885:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 97 00000100:00100000:3.0:1788843342.444105:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843342.444284:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775813120 00000100:00100000:1.0:1788843342.444317:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775813120 00000100:00100000:1.0:1788843342.444437:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 98 00000100:00100000:1.0:1788843342.444451:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab543b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+12:13889:x1875737775813120:12345-192.168.203.29@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788843342.444495:0:14413:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788843342.444519:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788843342.444524:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788843342.444528:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788843342.444530:0:14413:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788843342.448279:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab543b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+12:13889:x1875737775813120:12345-192.168.203.29@tcp:256:mount.lustre.0 Request processed in 3813us (4170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843342.448297:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 98 00000100:00100000:3.0:1788843342.452508:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843342.456971:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775813248 00000100:00100000:0.0:1788843342.456995:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775813248 00000100:00100000:0.0:1788843342.457939:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 99 00000100:00100000:0.0:1788843342.457958:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7d9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+12:13889:x1875737775813248:12345-192.168.203.29@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788843342.457981:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843342.458006:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8daa42697e00/0xc6b8ac1b09160b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084ca1 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843342.458125:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8daa42697e00/0xc6b8ac1b09160b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ca1 expref: 13 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843342.458151:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8daa42697e00/0xc6b8ac1b09160b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ca1 expref: 13 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843342.458162:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42697e00, rc 0) 00000100:00100000:0.0:1788843342.458317:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7d9bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+13:13889:x1875737775813248:12345-192.168.203.29@tcp:101:mount.lustre.0 Request processed in 364us (5824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843342.458326:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 99 00000100:00100000:3.0:1788843342.463806:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843342.464182:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775813376 00000100:00100000:1.0:1788843342.464195:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775813376 00000100:00100000:1.0:1788843342.464324:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 100 00000100:00100000:1.0:1788843342.464338:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7d9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+13:13889:x1875737775813376:12345-192.168.203.29@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788843342.464972:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7d9bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+13:13889:x1875737775813376:12345-192.168.203.29@tcp:501:mount.lustre.0 Request processed in 633us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843342.464981:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 100 00000100:00100000:2.0:1788843342.467583:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843342.467939:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775813504 00000100:00100000:0.0:1788843342.467953:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775813504 00000100:00100000:0.0:1788843342.468024:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 101 00000100:00100000:0.0:1788843342.468037:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7d9bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+13:13889:x1875737775813504:12345-192.168.203.29@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788843342.468477:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7d9bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+13:13889:x1875737775813504:12345-192.168.203.29@tcp:503:mount.lustre.0 Request processed in 441us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843342.468486:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 101 00000100:00100000:3.0:1788843342.472848:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843342.473026:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775813632 00000100:00100000:1.0:1788843342.473040:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775813632 00000100:00100000:1.0:1788843342.473179:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 102 00000100:00100000:1.0:1788843342.473193:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7d9bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+13:13899:x1875737775813632:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788843342.473584:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7d9bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+13:13899:x1875737775813632:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 392us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843342.473594:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 102 00000100:00100000:2.0:1788843342.479442:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843342.485249:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775813760 00000100:00100000:0.0:1788843342.485274:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775813760 00000100:00100000:0.0:1788843342.485417:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 103 00000100:00100000:0.0:1788843342.485431:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7d9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+13:13899:x1875737775813760:12345-192.168.203.29@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788843342.485791:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7d9b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+13:13899:x1875737775813760:12345-192.168.203.29@tcp:502:llog_process_th.0 Request processed in 361us (6362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843342.485801:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 103 00000100:00100000:2.0:1788843342.492584:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843342.497923:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775813888 00000100:00100000:0.0:1788843342.497946:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775813888 00000100:00100000:2.0:1788843342.498183:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:2.0:1788843342.498196:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2355:x1875737775813888:12345-192.168.203.29@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788843342.498243:0:14421:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 57dd4253-596f-4283-9b4c-1047ff1bcc24@192.168.203.29@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:2.0:1788843342.498300:0:14421:0:(genops.c:1385:class_connect()) connect: client 57dd4253-596f-4283-9b4c-1047ff1bcc24, cookie 0xc6b8ac1b09160b8 00000004:00100000:2.0:1788843342.498367:0:14421:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788843342.498545:0:14421:0:(import.c:65:import_set_state_nolock()) ffff8daa4266e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788843342.501967:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:2355:x1875737775813888:12345-192.168.203.29@tcp:38:mount.lustre.0 Request processed in 3752us (9380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843342.501987:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:3.0:1788843342.516733:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843342.516787:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843342.516912:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775814144 00000100:00100000:2.0:1788843342.516925:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775814144 00000100:00100000:2.0:1788843342.517010:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775814016 00000100:00100000:2.0:1788843342.517013:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775814016 00000100:00100000:2.0:1788843342.517039:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:2.0:1788843342.517051:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57dd4253-596f-4283-9b4c-1047ff1bcc24+7:13889:x1875737775814144:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788843342.517097:0:14420:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788843342.517202:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57dd4253-596f-4283-9b4c-1047ff1bcc24+7:13889:x1875737775814144:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 152us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843342.517211:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:2.0:1788843342.517232:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:2.0:1788843342.517257:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:0:x1875737775814016:12345-192.168.203.29@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788843342.517269:0:14420:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788843342.517292:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:0:x1875737775814016:12345-192.168.203.29@tcp:41:mount.lustre.0 Request processed in 36us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843342.517297:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00080000:3.0:1788843342.517766:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843342.520451:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843342.520607:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775814272 00000100:00100000:2.0:1788843342.520622:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775814272 00000100:00100000:2.0:1788843342.520701:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:2.0:1788843342.520713:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:13889:x1875737775814272:12345-192.168.203.29@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788843342.520832:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:13889:x1875737775814272:12345-192.168.203.29@tcp:40:mount.lustre.0 Request processed in 120us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843342.520849:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:2.0:1788843342.527834:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843342.528042:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775814656 00000100:00100000:0.0:1788843342.528057:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775814656 00000100:00100000:0.0:1788843342.528141:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:0.0:1788843342.528156:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:13889:x1875737775814656:12345-192.168.203.29@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788843342.528262:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788843342.528411:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:13889:x1875737775814656:12345-192.168.203.29@tcp:33:mount.lustre.0 Request processed in 259us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843342.528420:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:3.0:1788843342.531163:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843342.531222:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843342.534336:0:16114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775814400 00000100:00100000:1.0:1788843342.534392:0:16114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775814400 00000100:00100000:1.0:1788843342.534443:0:16114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775814528 00000100:00100000:1.0:1788843342.534447:0:16114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775814528 00000100:00100000:1.0:1788843342.534484:0:16114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:1.0:1788843342.534496:0:16114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2355:x1875737775814400:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788843342.534538:0:16114:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 57dd4253-596f-4283-9b4c-1047ff1bcc24@192.168.203.29@tcp t0 exp 0000000000000000 cur 466 last 0 00000100:00100000:3.0:1788843342.537514:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:3.0:1788843342.537532:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2355:x1875737775814528:12345-192.168.203.29@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788843342.537792:0:15108:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 57dd4253-596f-4283-9b4c-1047ff1bcc24@192.168.203.29@tcp t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:3.0:1788843342.537907:0:15108:0:(genops.c:1385:class_connect()) connect: client 57dd4253-596f-4283-9b4c-1047ff1bcc24, cookie 0xc6b8ac1b09160bf 00002000:00100000:3.0:1788843342.537927:0:15108:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 57dd4253-596f-4283-9b4c-1047ff1bcc24/ffff8dab77922800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788843342.537958:0:15108:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000020:00000080:1.0:1788843342.540984:0:16114:0:(genops.c:1385:class_connect()) connect: client 57dd4253-596f-4283-9b4c-1047ff1bcc24, cookie 0xc6b8ac1b09160c6 00002000:00100000:1.0:1788843342.541002:0:16114:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 57dd4253-596f-4283-9b4c-1047ff1bcc24/ffff8dab7c18a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113970 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788843342.541018:0:16114:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788843342.541401:0:15108:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788843342.541452:0:15108:0:(import.c:65:import_set_state_nolock()) ffff8dab77927000 : changing import state from RECOVER to FULL 00002000:00080000:1.0:1788843342.543454:0:16114:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788843342.543505:0:16114:0:(import.c:65:import_set_state_nolock()) ffff8dab7c18c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788843342.544020:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:2355:x1875737775814528:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 6482us (12790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843342.544035:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:1.0:1788843342.544726:0:16114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:2355:x1875737775814400:12345-192.168.203.29@tcp:8:mount.lustre.0 Request processed in 10226us (13571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843342.544737:0:16114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:2.0:1788843342.688617:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843342.688798:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775814784 00000100:00100000:1.0:1788843342.688812:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775814784 00000100:00100000:1.0:1788843342.688894:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:1.0:1788843342.688907:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:13921:x1875737775814784:12345-192.168.203.29@tcp:101:mkdir.0 00010000:00010000:1.0:1788843342.688934:0:15380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843342.688964:0:15380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a600/0xc6b8ac1b09160cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ccb expref: -99 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843342.689050:0:15380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b09160d4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843342.689066:0:15380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b09160d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843342.689105:0:15380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b09160d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843342.689163:0:15380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788843342.689168:0:15380:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788843342.689196:0:15380:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b09160d4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843342.689227:0:15380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a600/0xc6b8ac1b09160cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ccb expref: 8 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843342.689257:0:15380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b09160d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ccb expref: 7 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843342.689268:0:15380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910200) 00010000:00010000:1.0:1788843342.689272:0:15380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788843342.689278:0:15380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b600, rc 0) 00000100:00100000:1.0:1788843342.689524:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57dd4253-596f-4283-9b4c-1047ff1bcc24+7:13921:x1875737775814784:12345-192.168.203.29@tcp:101:mkdir.0 Request processed in 618us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843342.689532:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00010000:00010000:2.0:1788843343.430828:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843344.452634:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843344.711780:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795727744:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788843344.711890:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843344.712385:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795727744 00000100:00100000:0.0:1788843344.712396:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795727744 00000100:00100000:0.0:1788843344.712471:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788843344.712483:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795727744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788843344.712548:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843344.712639:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795727744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 158us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843344.712647:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788843344.712835:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795727744:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788843344.720929:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1788843345.272099:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b87c6d43-928f-4231-aaff-6c642a37da7f 00000001:00100000:0.0:1788843345.272132:0:5868:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 57dd4253-596f-4283-9b4c-1047ff1bcc24 00010000:00010000:2.0:1788843345.476733:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788843345.619720:0:16389:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788843345.735628:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795727872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788843345.735703:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843345.735756:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795728384:0@lo:400:kworker.0 00000100:00100000:1.0:1788843345.735861:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795728128:0@lo:400:kworker.0 00000100:00100000:1.0:1788843345.739672:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843345.739704:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843345.739747:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788843345.739760:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795728000:0@lo:400:kworker.0 00000100:00100000:0.0:1788843345.739861:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843345.739891:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795728512:0@lo:400:kworker.0 00000100:00100000:0.0:1788843345.739916:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843345.739930:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795728640:0@lo:400:kworker.0 00000100:00100000:0.0:1788843345.739959:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795728256:0@lo:400:kworker.0 00000100:00100000:1.0:1788843345.739972:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843345.739993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843345.740029:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795727872 00000100:00100000:0.0:1788843345.740038:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795727872 00000100:00100000:0.0:1788843345.740098:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788843345.740119:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795727872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788843345.740160:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788843345.740211:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795727872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (4508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843345.740218:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788843345.740256:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795728384 00000100:00100000:0.0:1788843345.740260:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795728384 00000100:00100000:1.0:1788843345.740286:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795728128 00000100:00100000:0.0:1788843345.740291:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795728512 00000100:00100000:1.0:1788843345.740292:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795728128 00000100:00100000:0.0:1788843345.740297:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795728512 00000100:00100000:0.0:1788843345.740319:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795728640 00000100:00100000:0.0:1788843345.740322:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795728640 00000100:00100000:1.0:1788843345.740334:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795728256 00000100:00100000:0.0:1788843345.740362:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788843345.740369:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795728384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843345.740405:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875737795728384:12345-0@lo:400:kworker.0 Request processed in 36us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843345.740412:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788843345.740419:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795728256 00000100:00100000:0.0:1788843345.740428:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788843345.740438:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795728512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843345.740453:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843345.740464:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795728128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843345.740471:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875737795728512:12345-0@lo:400:kworker.0 Request processed in 35us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843345.740478:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788843345.740491:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788843345.740500:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875737795728640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843345.740513:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1875737795728128:12345-0@lo:400:kworker.0 Request processed in 51us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843345.740521:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788843345.740536:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843345.740542:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795728256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843345.741301:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795728256:12345-0@lo:400:kworker.0 Request processed in 756us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843345.741312:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788843345.741338:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795728000 00000100:00100000:1.0:1788843345.742490:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795728000 00000100:00100000:1.0:1788843345.742790:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788843345.742804:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7d9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+19:3306:x1875737795728000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843345.743308:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7d9b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+19:3306:x1875737795728000:12345-0@lo:400:kworker.0 Request processed in 505us (3444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843345.743319:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788843345.744283:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1875737795728128:0@lo:400:kworker.0 00000100:00080000:1.0:1788843345.744518:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843345.744525:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788843345.745855:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795728000:0@lo:400:kworker.0 00000100:00100000:1.0:1788843345.745875:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1875737795728512:0@lo:400:kworker.0 00000100:00100000:1.0:1788843345.745896:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795727872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843345.745907:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875737795728384:0@lo:400:kworker.0 00000100:00100000:1.0:1788843345.747990:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795728256:0@lo:400:kworker.0 00000100:00100000:0.0:1788843345.748127:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1875737795728640:12345-0@lo:400:kworker.0 Request processed in 7627us (8153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843345.748138:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788843345.748765:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1875737795728640:0@lo:400:kworker.0 00000001:00100000:0.0:1788843346.305004:0:7650:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 57dd4253-596f-4283-9b4c-1047ff1bcc24 00010000:00010000:0.0:1788843346.501899:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788843346.823179:0:6719:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 57dd4253-596f-4283-9b4c-1047ff1bcc24 00010000:00010000:0.0:1788843347.526012:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843347.601767:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843347.601814:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843347.601840:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843347.601864:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843347.601882:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843347.601899:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843347.601923:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843347.601949:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775815296 00000100:00100000:2.0:1788843347.601966:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775815296 00000100:00100000:2.0:1788843347.602014:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775815552 00000100:00100000:2.0:1788843347.602017:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775815552 00000100:00100000:2.0:1788843347.602030:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775815168 00000100:00100000:2.0:1788843347.602032:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775815168 00000100:00100000:2.0:1788843347.602042:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775815680 00000100:00100000:2.0:1788843347.602044:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775815680 00000100:00100000:2.0:1788843347.602058:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:2.0:1788843347.602066:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2358:x1875737775815296:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843347.602145:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ffb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2358:x1875737775815296:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 78us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843347.602153:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:2.0:1788843347.602172:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1788843347.602178:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+5:2358:x1875737775815552:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843347.602204:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+5:2358:x1875737775815552:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843347.602211:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1788843347.602221:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:2.0:1788843347.602227:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2358:x1875737775815168:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843347.602247:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2358:x1875737775815168:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 20us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843347.602253:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:2.0:1788843347.602263:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:2.0:1788843347.602268:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+5:2358:x1875737775815680:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843347.602286:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+5:2358:x1875737775815680:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 18us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843347.602300:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:2.0:1788843347.602323:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775814912 00000100:00100000:2.0:1788843347.602327:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775814912 00000100:00100000:2.0:1788843347.602382:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 105 00000100:00100000:2.0:1788843347.602390:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7d9b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+13:2358:x1875737775814912:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843347.602416:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7d9b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+13:2358:x1875737775814912:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 27us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843347.602421:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 105 00000100:00100000:2.0:1788843347.602451:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775815040 00000100:00100000:2.0:1788843347.602455:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775815040 00000100:00100000:2.0:1788843347.602481:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775815424 00000100:00100000:2.0:1788843347.602484:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775815424 00000100:00100000:2.0:1788843347.602505:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:2.0:1788843347.602512:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+6:2358:x1875737775815040:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843347.602537:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73ff9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+6:2358:x1875737775815040:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 27us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843347.602543:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:2.0:1788843347.602556:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:2.0:1788843347.602562:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:2358:x1875737775815424:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843347.602583:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:2358:x1875737775815424:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 22us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843347.602589:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00080000:2.0:1788843347.602608:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788843347.602612:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788843347.602615:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788843348.548560:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788843349.495305:0:16541:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa4f8ba70 20000000:00000080:3.0:1788843349.495322:0:16541:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8daa4276f800 uarg=0000000000000000 20000000:01000000:3.0:1788843349.495720:0:16541:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788843349.495727:0:16541:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788843349.495731:0:16541:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788843349.496652:0:16542:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1788843349.496789:0:16541:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788843349.504580:0:16541:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788843349.504627:0:16541:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8daa42696a00/0xc6b8ac1b09160db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.504646:0:16541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab7799e800/0xc6b8ac1b0915dd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915dcb expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.504655:0:16541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915e1f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915e18 expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.504662:0:16541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab4933bc00/0xc6b8ac1b0915f53 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b0915f4c expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.504672:0:16541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dab49375600/0xc6b8ac1b0916079 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c3f expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.504679:0:16541:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8daa42697e00/0xc6b8ac1b09160b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ca1 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.504687:0:16541:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8daa42696a00/0xc6b8ac1b09160db lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.504730:0:16541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8daa42697e00/0xc6b8ac1b09160b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ca1 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.504810:0:16541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8daa42697e00/0xc6b8ac1b09160b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ca1 expref: 12 pid: 14415 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843349.504828:0:16541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875737795728768:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843349.506324:0:16541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab49375600/0xc6b8ac1b0916079 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084c3f expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.506366:0:16541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab49375600/0xc6b8ac1b0916079 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084c3f expref: 12 pid: 14415 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843349.506381:0:16541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7c183100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875737795728896:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843349.506420:0:16541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab4933bc00/0xc6b8ac1b0915f53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0915f4c expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.506429:0:16541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab4933bc00/0xc6b8ac1b0915f53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0915f4c expref: 18 pid: 14413 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843349.506454:0:16541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875737795729024:0@lo:104: 00000100:00100000:3.0:1788843349.506490:0:16541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788843349.506542:0:16541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915e1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0915e18 expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.506551:0:16541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915e1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0915e18 expref: 18 pid: 14413 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843349.506560:0:16541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875737795729152:0@lo:104: 00000100:00100000:3.0:1788843349.506581:0:16541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843349.506612:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795729024 00000100:00100000:3.0:1788843349.506619:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795729024 00000100:00100000:3.0:1788843349.506659:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795729152 00000100:00100000:3.0:1788843349.506662:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795729152 00000100:00100000:3.0:1788843349.506678:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843349.506686:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:845ba2f4-9198-464f-ba29-11072ff30647+4:16541:x1875737795729024:12345-0@lo:104: 00010000:00010000:3.0:1788843349.506698:0:14403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b0915f4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0915f53 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.506740:0:14403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788843349.506762:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:845ba2f4-9198-464f-ba29-11072ff30647+4:16541:x1875737795729024:12345-0@lo:104: Request processed in 61us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843349.506770:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788843349.506790:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788843349.506796:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab77b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:845ba2f4-9198-464f-ba29-11072ff30647+3:16541:x1875737795729152:12345-0@lo:104: 00010000:00010000:3.0:1788843349.506804:0:14403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab821c4e00/0xc6b8ac1b0915e18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0915e1f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.506858:0:14403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788843349.506865:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab77b7e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:845ba2f4-9198-464f-ba29-11072ff30647+3:16541:x1875737795729152:12345-0@lo:104: Request processed in 69us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843349.506870:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788843349.506889:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788843349.506896:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b0915f4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0915f53 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.506903:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab41532200 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843349.506907:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b0915f4c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0915f53 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.506915:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b0915f4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0915f53 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843349.506924:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b0915f4c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0915f53 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843349.506930:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788843349.507093:0:14409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b0915f4c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915f53 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.507100:0:14409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843349.507122:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b0915f4c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915f53 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.507130:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab41532200/0xc6b8ac1b0915f4c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915f53 expref: -99 pid: 15823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.507156:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843349.507159:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab821c4e00/0xc6b8ac1b0915e18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0915e1f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.507165:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab821c4e00 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843349.507168:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4e00/0xc6b8ac1b0915e18 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0915e1f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.507175:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab821c4e00/0xc6b8ac1b0915e18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0915e1f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843349.507182:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab821c4e00/0xc6b8ac1b0915e18 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0915e1f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843349.507187:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788843349.507202:0:14409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab821c4e00/0xc6b8ac1b0915e18 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915e1f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.507207:0:14409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843349.507221:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab821c4e00/0xc6b8ac1b0915e18 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915e1f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.507227:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab821c4e00/0xc6b8ac1b0915e18 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915e1f expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.507237:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843349.507239:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843349.507240:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843349.507262:0:16541:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dab7799e800/0xc6b8ac1b0915dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc6b8ac1b0915dcb expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.507278:0:16541:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dab7799e800/0xc6b8ac1b0915dd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc6b8ac1b0915dcb expref: 18 pid: 14415 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843349.507287:0:16541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e849180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875737795729536:0@lo:104: 00000100:00100000:3.0:1788843349.507316:0:16541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843349.507364:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788843349.507374:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795729536 00000100:00100000:3.0:1788843349.507378:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795729536 00000100:00100000:3.0:1788843349.507398:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788843349.507404:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c05d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:845ba2f4-9198-464f-ba29-11072ff30647+3:16541:x1875737795729536:12345-0@lo:104: 00010000:00010000:3.0:1788843349.507412:0:14403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.129@tcp lock: ffff8dab4933b200/0xc6b8ac1b0915dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0915dd2 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.507445:0:14403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788843349.507450:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c05d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:845ba2f4-9198-464f-ba29-11072ff30647+3:16541:x1875737795729536:12345-0@lo:104: Request processed in 47us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843349.507456:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788843349.507667:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788843349.507673:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.129@tcp lock: ffff8dab4933b200/0xc6b8ac1b0915dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc6b8ac1b0915dd2 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.507679:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b200 already unused, calling callback (ffffffffc1a4ec20) 10000000:00010000:3.0:1788843349.507683:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933b200/0xc6b8ac1b0915dcb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc6b8ac1b0915dd2 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.507690:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.129@tcp lock: ffff8dab4933b200/0xc6b8ac1b0915dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc6b8ac1b0915dd2 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788843349.507707:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.129@tcp lock: ffff8dab4933b200/0xc6b8ac1b0915dcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc6b8ac1b0915dd2 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843349.507713:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788843349.507729:0:14409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.129@tcp lock: ffff8dab4933b200/0xc6b8ac1b0915dcb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915dd2 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.507734:0:14409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788843349.507741:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.129@tcp lock: ffff8dab4933b200/0xc6b8ac1b0915dcb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915dd2 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.507802:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.129@tcp lock: ffff8dab4933b200/0xc6b8ac1b0915dcb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc6b8ac1b0915dd2 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.507818:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843349.507820:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788843349.507822:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788843349.507834:0:16541:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69916180 going to sleep for 11 seconds 00000100:00100000:3.0:1788843349.508077:0:16541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875737795729024:0@lo:104: 00000100:00100000:3.0:1788843349.508100:0:16541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875737795729152:0@lo:104: 00000100:00100000:3.0:1788843349.508108:0:16541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e849180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875737795729536:0@lo:104: 00010000:00010000:0.0:1788843349.508392:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843349.508405:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:845ba2f4-9198-464f-ba29-11072ff30647:3307:1875737795729664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843349.508453:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843349.508486:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788843349.508498:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:845ba2f4-9198-464f-ba29-11072ff30647:3307:1875737795729408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843349.508519:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843349.508613:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795729664 00000100:00100000:2.0:1788843349.508618:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795729664 00010000:00010000:2.0:1788843349.508642:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab7799e800/0xc6b8ac1b0915dd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0915dcb expref: 19 pid: 14415 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843349.508661:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795729408 00000100:00100000:2.0:1788843349.508664:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795729408 00010000:00010000:2.0:1788843349.508674:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915e1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0915e18 expref: 20 pid: 14413 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843349.508686:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788843349.508693:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:845ba2f4-9198-464f-ba29-11072ff30647+20:3307:x1875737795729664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843349.508704:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843349.508710:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab7799e800/0xc6b8ac1b0915dd2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0915dcb expref: 20 pid: 14415 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843349.508719:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab7799e800/0xc6b8ac1b0915dd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0915dcb expref: 20 pid: 14415 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843349.508735:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab7799e800/0xc6b8ac1b0915dd2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0915dcb expref: 20 pid: 14415 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843349.508760:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843349.508793:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:845ba2f4-9198-464f-ba29-11072ff30647+19:3307:x1875737795729664:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843349.508800:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788843349.508817:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788843349.508823:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:845ba2f4-9198-464f-ba29-11072ff30647+18:3307:x1875737795729408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788843349.508831:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843349.508835:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915e1f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0915e18 expref: 18 pid: 14413 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843349.508861:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915e1f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0915e18 expref: 18 pid: 14413 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843349.508872:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0915e1f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0915e18 expref: 18 pid: 14413 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843349.508881:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843349.508904:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:845ba2f4-9198-464f-ba29-11072ff30647+17:3307:x1875737795729408:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843349.508910:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788843349.509332:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:845ba2f4-9198-464f-ba29-11072ff30647:3307:1875737795729408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843349.509376:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:845ba2f4-9198-464f-ba29-11072ff30647:3307:1875737795729664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843349.509792:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:845ba2f4-9198-464f-ba29-11072ff30647:3305:1875737795729280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788843349.509828:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843349.510114:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795729280 00000100:00100000:3.0:1788843349.510120:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795729280 00010000:00010000:3.0:1788843349.510144:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab4933bc00/0xc6b8ac1b0915f53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0915f4c expref: 17 pid: 14413 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843349.510174:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788843349.510181:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73b54850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:845ba2f4-9198-464f-ba29-11072ff30647+17:3305:x1875737795729280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788843349.510203:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843349.510210:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab4933bc00/0xc6b8ac1b0915f53 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc6b8ac1b0915f4c expref: 17 pid: 14413 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.510218:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab4933bc00/0xc6b8ac1b0915f53 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc6b8ac1b0915f4c expref: 17 pid: 14413 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.510230:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab4933bc00/0xc6b8ac1b0915f53 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc6b8ac1b0915f4c expref: 17 pid: 14413 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.510242:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843349.510285:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73b54850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:845ba2f4-9198-464f-ba29-11072ff30647+16:3305:x1875737795729280:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843349.510292:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788843349.510591:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab77b7ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:845ba2f4-9198-464f-ba29-11072ff30647:3305:1875737795729280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788843349.518968:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843349.519005:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843349.519034:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775815808 00000100:00100000:0.0:1788843349.519042:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775815808 00010000:00010000:0.0:1788843349.519079:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8daa42697e00/0xc6b8ac1b09160b1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ca1 expref: 13 pid: 14415 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843349.519114:0:16541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875737795728768:192.168.203.29@tcp:104: 00000100:00100000:0.0:1788843349.519128:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775815936 00000100:00100000:3.0:1788843349.519131:0:16541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7c183100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16541:1875737795728896:192.168.203.29@tcp:104: 00000100:00100000:0.0:1788843349.519133:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775815936 00010000:00010000:0.0:1788843349.519150:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dab49375600/0xc6b8ac1b0916079 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084c3f expref: 14 pid: 14415 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843349.519169:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00010000:00010000:3.0:1788843349.519172:0:16541:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8daa42696a00/0xc6b8ac1b09160db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843349.519181:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80593374-1a93-4bf4-84d9-50ccd339dd04+14:2358:x1875737775815808:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843349.519197:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843349.519203:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8daa42697e00/0xc6b8ac1b09160b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ca1 expref: 14 pid: 14415 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.519214:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8daa42697e00/0xc6b8ac1b09160b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ca1 expref: 14 pid: 14415 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.519231:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8daa42697e00/0xc6b8ac1b09160b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ca1 expref: 14 pid: 14415 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.519259:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843349.519323:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80593374-1a93-4bf4-84d9-50ccd339dd04+13:2358:x1875737775815808:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 146us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843349.519331:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:0.0:1788843349.519375:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:0.0:1788843349.519384:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80593374-1a93-4bf4-84d9-50ccd339dd04+12:2359:x1875737775815936:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843349.519392:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843349.519396:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dab49375600/0xc6b8ac1b0916079 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084c3f expref: 12 pid: 14415 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.519404:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dab49375600/0xc6b8ac1b0916079 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084c3f expref: 12 pid: 14415 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.519414:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dab49375600/0xc6b8ac1b0916079 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084c3f expref: 12 pid: 14415 timeout: 573 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.519424:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8daa42696a00/0xc6b8ac1b09160db lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.519432:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8daa42696a00/0xc6b8ac1b09160db lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.519444:0:14405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8daa42696a00/0xc6b8ac1b09160db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.519450:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8daa42696a00/0xc6b8ac1b09160db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.519466:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8daa42696a00/0xc6b8ac1b09160db lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.519474:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8daa42696a00/0xc6b8ac1b09160db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.519480:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843349.519484:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8daa42696a00/0xc6b8ac1b09160db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.519492:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8daa42696a00/0xc6b8ac1b09160db lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.519512:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8daa42696a00/0xc6b8ac1b09160db lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843349.519521:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843349.519549:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:80593374-1a93-4bf4-84d9-50ccd339dd04+11:2359:x1875737775815936:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 167us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843349.519556:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00010000:00010000:3.0:1788843349.519656:0:16541:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8daa42696a00/0xc6b8ac1b09160db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.519666:0:16541:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8daa42696a00/0xc6b8ac1b09160db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843349.519673:0:16541:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8daa42696a00/0xc6b8ac1b09160db lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16541 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843349.576290:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843349.829915:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788843349.829942:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795729792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788843349.830022:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843349.830160:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795729792 00000100:00100000:2.0:1788843349.830169:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795729792 00000100:00100000:2.0:1788843349.830236:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843349.830246:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795729792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788843349.830279:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788843349.830331:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795729792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843349.830339:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788843349.830413:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795729792:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788843349.830633:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788843350.596657:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843350.852595:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795729920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788843350.852674:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843350.852834:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795729920 00000100:00100000:1.0:1788843350.852843:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795729920 00000100:00100000:1.0:1788843350.852903:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788843350.852913:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795729920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843350.852947:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843350.853006:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795729920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843350.853014:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788843350.853058:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795729920:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788843350.853247:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843350.854007:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ce70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795730432:0@lo:400:kworker.0 00000100:00100000:2.0:1788843350.854048:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843350.854087:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843350.854094:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ce71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795730304:0@lo:400:kworker.0 00000100:00100000:3.0:1788843350.854102:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ce72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795730048:0@lo:400:kworker.0 00000100:00100000:2.0:1788843350.854116:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843350.854142:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843350.854154:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795730432 00000100:00100000:2.0:1788843350.854160:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795730432 00000100:00100000:3.0:1788843350.854168:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ce71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795730560:0@lo:400:kworker.0 00000100:00100000:3.0:1788843350.854188:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843350.854205:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788843350.854211:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ce71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795730176:0@lo:400:kworker.0 00000100:00100000:3.0:1788843350.854233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843350.854269:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795730048 00000100:00100000:3.0:1788843350.854273:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795730048 00000100:00100000:3.0:1788843350.854303:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788843350.854311:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7d9b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+16:3306:x1875737795730048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843350.854366:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795730304 00000100:00100000:2.0:1788843350.854370:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795730304 00000100:00100000:3.0:1788843350.854374:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7d9b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+16:3306:x1875737795730048:12345-0@lo:400:kworker.0 Request processed in 63us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843350.854381:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788843350.854386:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795730560 00000100:00100000:2.0:1788843350.854388:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795730560 00000100:00100000:2.0:1788843350.854400:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788843350.854407:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795730432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788843350.854411:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788843350.854417:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795730304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843350.854444:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795730432:12345-0@lo:400:kworker.0 Request processed in 37us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843350.854455:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788843350.854468:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788843350.854474:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795730560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843350.854507:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795730560:12345-0@lo:400:kworker.0 Request processed in 29us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843350.854514:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788843350.854536:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788843350.856925:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795730176 00000100:00100000:0.0:1788843350.856938:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795730176 00000100:00100000:0.0:1788843350.856999:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788843350.857009:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795730176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788843350.857106:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795730176:12345-0@lo:400:kworker.0 Request processed in 98us (2872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843350.857115:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788843350.857174:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ce71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795730176:0@lo:400:kworker.0 00000100:00100000:0.0:1788843350.857187:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ce72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:845ba2f4-9198-464f-ba29-11072ff30647:3306:1875737795730048:0@lo:400:kworker.0 00000100:00100000:0.0:1788843350.857198:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ce71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795730560:0@lo:400:kworker.0 00000100:00100000:3.0:1788843350.861293:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795730304:12345-0@lo:400:kworker.0 Request processed in 6864us (7164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843350.861307:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788843350.861481:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ce71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795730304:0@lo:400:kworker.0 00000100:00100000:2.0:1788843350.861495:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ce70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795730432:0@lo:400:kworker.0 10000000:01000000:1.0:1788843350.981520:0:14417:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788843350.981528:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab441fb000 from 10 10000000:01000000:1.0:1788843350.981534:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788843350.981582:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b09160e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843350.981594:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b09160e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843350.981616:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b09160e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843350.981644:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795730688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788843350.982160:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843350.982244:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab48bae6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843350.983310:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795730688 00000100:00100000:2.0:1788843350.983322:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795730688 00000100:00100000:2.0:1788843350.983473:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788843350.983495:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+16:14417:x1875737795730688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843350.983512:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843350.983532:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab49374a00/0xc6b8ac1b09160e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b09160e2 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843350.983561:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab49374a00/0xc6b8ac1b09160e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b09160e2 expref: 17 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843350.983572:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab49374a00/0xc6b8ac1b09160e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b09160e2 expref: 17 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843350.983581:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374a00, rc 0) 00000100:00100000:2.0:1788843350.983659:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+17:14417:x1875737795730688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (1498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843350.983666:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788843350.983943:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795730688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843350.984031:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b09160e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09160e9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843350.984042:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b09160e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b09160e9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843350.984123:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795730816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788843350.984163:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843350.984204:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab48bae6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843350.984919:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795730816 00000100:00100000:2.0:1788843350.984928:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795730816 00000100:00100000:2.0:1788843350.985068:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788843350.985088:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+17:14417:x1875737795730816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843350.985375:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+17:14417:x1875737795730816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843350.985383:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788843350.985492:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795730816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843350.985616:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795730944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788843350.985663:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843350.985699:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6e76b240 going to sleep for 11 seconds 00000100:00100000:1.0:1788843350.985768:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795730944 00000100:00100000:1.0:1788843350.985773:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795730944 00000100:00100000:1.0:1788843350.985796:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788843350.985801:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+17:14417:x1875737795730944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843350.986101:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+17:14417:x1875737795730944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 297us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843350.986107:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788843350.986213:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795730944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788843350.988126:0:16605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788843350.988213:0:14417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788843350.988236:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788843350.988248:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b09160e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09160e9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843350.988258:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933a600/0xc6b8ac1b09160e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09160e9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788843350.988267:0:14417:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788843350.988270:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab50469800 from 10 10000000:01000000:3.0:1788843350.988272:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788843350.988305:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7799e200/0xc6b8ac1b09160f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843350.988313:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab7799e200/0xc6b8ac1b09160f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843350.988323:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab7799e200/0xc6b8ac1b09160f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843350.988363:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795731072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788843350.988424:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788843350.988476:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab6e76b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788843350.988503:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795731072 00000100:00100000:3.0:1788843350.988509:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795731072 00000100:00100000:3.0:1788843350.988545:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788843350.988554:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+17:14417:x1875737795731072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788843350.988566:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843350.988579:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab7799f600/0xc6b8ac1b09160f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b09160f0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843350.988675:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab7799f600/0xc6b8ac1b09160f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b09160f0 expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843350.988759:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab7799f600/0xc6b8ac1b09160f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b09160f0 expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843350.988769:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799f600, rc 0) 00000100:00100000:3.0:1788843350.988819:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+18:14417:x1875737795731072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 265us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843350.988826:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788843350.989175:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e848e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795731072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788843350.989193:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab7799e200/0xc6b8ac1b09160f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09160f7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843350.989294:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab7799e200/0xc6b8ac1b09160f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b09160f7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843350.989379:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795731200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843350.989417:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843350.989447:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69916d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788843350.989462:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795731200 00000100:00100000:0.0:1788843350.989467:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795731200 00000100:00100000:0.0:1788843350.989668:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788843350.989678:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+18:14417:x1875737795731200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843350.989921:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+18:14417:x1875737795731200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 244us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843350.989931:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788843350.992099:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795731200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843350.992168:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795731328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843350.992235:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843350.992282:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69916d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788843350.992307:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795731328 00000100:00100000:0.0:1788843350.992313:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795731328 00000100:00100000:2.0:1788843350.995471:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788843350.995494:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+18:14417:x1875737795731328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843350.995971:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+18:14417:x1875737795731328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 485us (3734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843350.995981:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788843350.996237:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795731328:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788843351.000463:0:16606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788843351.001057:0:14417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788843351.001096:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788843351.001107:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab7799e200/0xc6b8ac1b09160f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09160f7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843351.001119:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab7799e200/0xc6b8ac1b09160f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b09160f7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788843351.001130:0:14417:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788843351.001145:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dab7c1e8000 from 10 10000000:01000000:1.0:1788843351.001147:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788843351.001186:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933ac00/0xc6b8ac1b09160fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843351.001194:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.129@tcp lock: ffff8dab4933ac00/0xc6b8ac1b09160fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843351.001203:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.129@tcp lock: ffff8dab4933ac00/0xc6b8ac1b09160fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843351.001227:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795731456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788843351.001294:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843351.001338:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab48bae240 going to sleep for 11 seconds 00000100:00100000:1.0:1788843351.001494:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795731456 00000100:00100000:1.0:1788843351.001502:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795731456 00000100:00100000:1.0:1788843351.001539:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788843351.001548:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+18:14417:x1875737795731456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843351.001562:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843351.001574:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab4933b000/0xc6b8ac1b0916105 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc6b8ac1b09160fe expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843351.001597:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab4933b000/0xc6b8ac1b0916105 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc6b8ac1b09160fe expref: 19 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843351.001825:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab4933b000/0xc6b8ac1b0916105 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc6b8ac1b09160fe expref: 19 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843351.001834:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933b000, rc 0) 00000100:00100000:1.0:1788843351.002052:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+19:14417:x1875737795731456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 503us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843351.002070:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788843351.002155:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e6bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795731456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843351.002172:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.129@tcp lock: ffff8dab4933ac00/0xc6b8ac1b09160fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916105 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843351.002182:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.129@tcp lock: ffff8dab4933ac00/0xc6b8ac1b09160fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc6b8ac1b0916105 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843351.002239:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ce70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795731584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788843351.002269:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843351.002334:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab412ed540 going to sleep for 11 seconds 00000100:00100000:3.0:1788843351.005830:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795731584 00000100:00100000:3.0:1788843351.005939:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795731584 00000100:00100000:3.0:1788843351.006079:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788843351.006090:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+19:14417:x1875737795731584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788843351.006404:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:845ba2f4-9198-464f-ba29-11072ff30647+19:14417:x1875737795731584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 315us (4132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843351.006412:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788843351.006577:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ce70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795731584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843351.006630:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795731712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788843351.006677:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843351.006815:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab699166c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788843351.008051:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795731712 00000100:00100000:1.0:1788843351.008061:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795731712 00000100:00100000:1.0:1788843351.008164:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788843351.008174:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7392f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+19:14417:x1875737795731712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843351.008409:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7392f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:845ba2f4-9198-464f-ba29-11072ff30647+19:14417:x1875737795731712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 236us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843351.008417:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788843351.008528:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:845ba2f4-9198-464f-ba29-11072ff30647:14417:1875737795731712:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788843351.011827:0:16609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788843351.011886:0:14417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788843351.011905:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.129@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788843351.011917:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.129@tcp lock: ffff8dab4933ac00/0xc6b8ac1b09160fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916105 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843351.011927:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.129@tcp lock: ffff8dab4933ac00/0xc6b8ac1b09160fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc6b8ac1b0916105 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788843351.111262:0:14455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788843351.318178:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843351.318407:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775816064 00000100:00100000:2.0:1788843351.318417:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775816064 00000100:00100000:2.0:1788843351.318470:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 116 00000100:00100000:2.0:1788843351.318479:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+11:13773:x1875737775816064:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788843351.318507:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843351.318533:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab49375e00/0xc6b8ac1b091610c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084cd2 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843351.318574:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab49375e00/0xc6b8ac1b091610c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084cd2 expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843351.318584:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab49375e00/0xc6b8ac1b091610c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084cd2 expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843351.318592:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375e00, rc 0) 00000100:00100000:2.0:1788843351.318676:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+12:13773:x1875737775816064:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 197us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843351.318683:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 116 00000100:00100000:2.0:1788843351.322507:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843351.322667:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775816192 00000100:00100000:0.0:1788843351.322678:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775816192 00000100:00100000:0.0:1788843351.322734:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 117 00000100:00100000:0.0:1788843351.322743:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+12:13773:x1875737775816192:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843351.323054:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+12:13773:x1875737775816192:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 310us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843351.323062:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 117 00000100:00100000:1.0:1788843351.347673:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843351.347714:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775816320 00000100:00100000:1.0:1788843351.347724:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775816320 00000100:00100000:1.0:1788843351.347770:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 118 00000100:00100000:1.0:1788843351.347781:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+12:13773:x1875737775816320:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788843351.348005:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+12:13773:x1875737775816320:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 225us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843351.348013:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 118 00000100:00100000:0.0:1788843351.361760:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843351.361900:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775816448 00000100:00100000:1.0:1788843351.361909:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775816448 00000100:00100000:1.0:1788843351.361972:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 119 00000100:00100000:1.0:1788843351.361982:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+12:13773:x1875737775816448:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788843351.361998:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788843351.362015:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0916113 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x34e059c607084cd9 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843351.362044:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0916113 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084cd9 expref: 13 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843351.362065:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dab4933a800/0xc6b8ac1b0916113 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084cd9 expref: 13 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843351.362085:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933a800, rc 0) 00000100:00100000:1.0:1788843351.362139:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:80593374-1a93-4bf4-84d9-50ccd339dd04+13:13773:x1875737775816448:12345-192.168.203.29@tcp:101:ll_cfg_requeue.0 Request processed in 158us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843351.362145:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 119 00000100:00100000:3.0:1788843351.366656:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843351.376123:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775816576 00000100:00100000:0.0:1788843351.376138:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775816576 00000100:00100000:0.0:1788843351.376205:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 120 00000100:00100000:0.0:1788843351.376215:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+13:13773:x1875737775816576:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788843351.376696:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+13:13773:x1875737775816576:12345-192.168.203.29@tcp:501:ll_cfg_requeue.0 Request processed in 481us (10051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843351.376715:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 120 00000100:00100000:0.0:1788843351.383552:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843351.383743:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775816704 00000100:00100000:2.0:1788843351.383754:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775816704 00000100:00100000:2.0:1788843351.383815:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 121 00000100:00100000:2.0:1788843351.383825:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+13:13773:x1875737775816704:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788843351.384064:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e18850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:80593374-1a93-4bf4-84d9-50ccd339dd04+13:13773:x1875737775816704:12345-192.168.203.29@tcp:503:ll_cfg_requeue.0 Request processed in 240us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843351.384080:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 121 00010000:00010000:1.0:1788843351.621630:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788843352.644729:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843352.720813:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843352.720863:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843352.720898:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843352.720934:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843352.720961:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843352.720974:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775817344 00000100:00100000:3.0:1788843352.720985:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775817344 00000100:00100000:1.0:1788843352.720993:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843352.721020:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775817088 00000100:00100000:1.0:1788843352.721026:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775817088 00000100:00100000:3.0:1788843352.721051:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775816960 00000100:00100000:3.0:1788843352.721055:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775816960 00000100:00100000:1.0:1788843352.721077:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775817600 00000100:00100000:1.0:1788843352.721082:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775817600 00000100:00100000:1.0:1788843352.721099:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775817216 00000100:00100000:1.0:1788843352.721102:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775817216 00000100:00100000:3.0:1788843352.721129:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:1.0:1788843352.721130:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:3.0:1788843352.721151:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:2358:x1875737775817344:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843352.721151:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2358:x1875737775817088:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843352.721262:0:16114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:2.0:1788843352.721274:0:16114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57dd4253-596f-4283-9b4c-1047ff1bcc24+5:2358:x1875737775817600:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843352.721336:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2358:x1875737775817088:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 195us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843352.721381:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:1.0:1788843352.721399:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:1.0:1788843352.721425:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2358:x1875737775817216:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843352.721489:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775816832 00000100:00100000:0.0:1788843352.721494:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775816832 00000100:00100000:0.0:1788843352.721526:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 122 00000100:00100000:0.0:1788843352.721534:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+13:2358:x1875737775816832:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843352.722975:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:2358:x1875737775817344:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 1767us (2009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843352.723014:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:3.0:1788843352.723050:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:3.0:1788843352.723071:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e6bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+6:2358:x1875737775816960:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:3.0:1788843352.723116:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+6:2358:x1875737775816960:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 58us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843352.723122:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00080000:3.0:1788843352.723147:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788843352.723152:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788843352.723156:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843352.724123:0:16114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e6bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57dd4253-596f-4283-9b4c-1047ff1bcc24+5:2358:x1875737775817600:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 2845us (3182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843352.724135:0:16114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:1.0:1788843352.724261:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2358:x1875737775817216:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 2837us (3267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843352.724269:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:0.0:1788843352.724403:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e18c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+13:2358:x1875737775816832:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 2804us (3534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843352.724414:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 122 00000100:00100000:0.0:1788843352.737438:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843352.738124:0:16114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775817472 00000100:00100000:2.0:1788843352.738149:0:16114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775817472 00000100:00100000:2.0:1788843352.738232:0:16114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:2.0:1788843352.738243:0:16114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57dd4253-596f-4283-9b4c-1047ff1bcc24+5:2358:x1875737775817472:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843352.738327:0:16114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57dd4253-596f-4283-9b4c-1047ff1bcc24+5:2358:x1875737775817472:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 85us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843352.738334:0:16114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00080000:3.0:1788843352.738429:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788843353.200314:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843353.200498:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775817728 00000100:00100000:0.0:1788843353.200508:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775817728 00000100:00100000:0.0:1788843353.200580:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:0.0:1788843353.200591:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+6:14431:x1875737775817728:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788843353.200611:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843353.200632:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b091611a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ce0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.200858:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696200/0xc6b8ac1b0916121 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.200883:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696200/0xc6b8ac1b0916121 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.200897:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696200/0xc6b8ac1b0916121 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.200928:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916128 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.200936:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.200942:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.201385:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b091612f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.201395:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b091612f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.201401:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b091612f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843353.201490:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788843353.201494:0:14421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788843353.201527:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b091612f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.201537:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696200/0xc6b8ac1b0916121 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.201602:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696200/0xc6b8ac1b0916121 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.201609:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696200/0xc6b8ac1b0916121 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.201624:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843353.201628:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696200/0xc6b8ac1b0916121 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.201636:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696200/0xc6b8ac1b0916121 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.201647:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910200) 00010000:00010000:0.0:1788843353.201649:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843353.201653:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696200/0xc6b8ac1b0916121 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.201659:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696200/0xc6b8ac1b0916121 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.201784:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916128 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.201791:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916128 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.201798:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.201803:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843353.201806:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916128 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.201811:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916128 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.201828:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8dab50f54300) 00010000:00010000:0.0:1788843353.201830:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843353.201833:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916128 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.201837:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916128 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.202321:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b091611a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ce0 expref: 8 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.202447:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696400/0xc6b8ac1b091612f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ce0 expref: 7 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.202457:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dab50f54400) 00010000:00010000:0.0:1788843353.202459:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788843353.202462:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42696400, rc 0) 00000100:00100000:0.0:1788843353.202536:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e848380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+7:14431:x1875737775817728:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 1946us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843353.202553:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:1.0:1788843353.214426:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843353.214607:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775817984 00000100:00100000:3.0:1788843353.214617:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775817984 00000100:00100000:3.0:1788843353.214681:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:3.0:1788843353.214693:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+7:14431:x1875737775817984:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843353.214713:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843353.214736:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0916136 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084ce7 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.214808:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091613d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.214821:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091613d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.214834:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091613d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.214866:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916144 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.214874:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916144 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.214882:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916144 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.215489:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091614b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.215501:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091614b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.215508:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091614b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843353.215519:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788843353.215701:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091613d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.215710:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091613d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.215717:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091613d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.215723:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799f200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843353.215727:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091613d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.215743:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091613d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.215756:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dab50f54400) 00010000:00010000:3.0:1788843353.215759:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843353.215763:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091613d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.215769:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b091613d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.215780:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916144 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.215786:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916144 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.215793:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916144 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.215798:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799f400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843353.215800:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916144 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.215806:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916144 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.215812:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8dab43e63500) 00010000:00010000:3.0:1788843353.215814:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843353.215817:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916144 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.215829:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916144 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.216740:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b0916136 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ce7 expref: 10 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.216760:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e400/0xc6b8ac1b091614b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ce7 expref: 9 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.216768:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab43e63800) 00010000:00010000:3.0:1788843353.216771:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843353.216774:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799e400, rc 0) 00000100:00100000:3.0:1788843353.216839:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+9:14431:x1875737775817984:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 2148us (2423us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788843353.216848:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:1.0:1788843353.234116:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843353.234399:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775818112 00000100:00100000:3.0:1788843353.234410:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775818112 00000100:00100000:3.0:1788843353.234465:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:3.0:1788843353.234476:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+9:14431:x1875737775818112:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788843353.234591:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+9:14431:x1875737775818112:12345-192.168.203.29@tcp:59:lhsmtool_posix.0 Request processed in 116us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843353.234600:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:1.0:1788843353.270409:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843353.270574:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775818240 00000100:00100000:2.0:1788843353.270584:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775818240 00000100:00100000:2.0:1788843353.270645:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:2.0:1788843353.270656:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+9:14437:x1875737775818240:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:2.0:1788843353.270676:0:15380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843353.270697:0:15380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916159 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084cee expref: -99 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.270761:0:15380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0916160 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.270776:0:15380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0916160 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.270788:0:15380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0916160 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.270802:0:15380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0916167 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.270810:0:15380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0916167 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.270816:0:15380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0916167 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.271046:0:15380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0916160 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.271054:0:15380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0916160 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.271070:0:15380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0916160 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.271076:0:15380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843353.271081:0:15380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0916160 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.271089:0:15380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0916160 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.271101:0:15380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910200) 00010000:00010000:2.0:1788843353.271104:0:15380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843353.271108:0:15380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0916160 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.271114:0:15380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0916160 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.271125:0:15380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0916167 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.271132:0:15380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0916167 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.271137:0:15380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0916167 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.271159:0:15380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374c00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843353.271162:0:15380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0916167 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.271167:0:15380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0916167 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.271176:0:15380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dab54910d00) 00010000:00010000:2.0:1788843353.271178:0:15380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843353.271181:0:15380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0916167 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.271186:0:15380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b0916167 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.271216:0:15380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916159 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084cee expref: 10 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.271225:0:15380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910200) 00010000:00010000:2.0:1788843353.271228:0:15380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843353.271231:0:15380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916159 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084cee expref: 10 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.271240:0:15380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375c00, rc 0) 00000100:00100000:2.0:1788843353.271302:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+9:14437:x1875737775818240:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 648us (903us total) trans 0 rc 301/301 00000100:00100000:2.0:1788843353.271309:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:1.0:1788843353.278987:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843353.279606:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775818368 00000100:00100000:3.0:1788843353.279617:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775818368 00000100:00100000:3.0:1788843353.279674:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:3.0:1788843353.279685:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b87c6d43-928f-4231-aaff-6c642a37da7f+9:14437:x1875737775818368:12345-192.168.203.29@tcp:700:lfs.0 00000100:00100000:3.0:1788843353.279787:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b87c6d43-928f-4231-aaff-6c642a37da7f+9:14437:x1875737775818368:12345-192.168.203.29@tcp:700:lfs.0 Request processed in 104us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843353.279795:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:1.0:1788843353.281884:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843353.281977:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775818624 00000100:00100000:3.0:1788843353.281987:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775818624 00000100:00100000:3.0:1788843353.282040:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:3.0:1788843353.282050:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+9:14437:x1875737775818624:12345-192.168.203.29@tcp:36:lfs.0 00010000:00010000:3.0:1788843353.282115:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843353.282142:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b091609c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084c69 expref: 9 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.282163:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910200) 00010000:00010000:3.0:1788843353.282169:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843353.282718:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091616e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.282736:0:14420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b09160d4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084ccb expref: 5 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.282744:0:14420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091616e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.282777:0:14420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b09160d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ccb expref: 5 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.282790:0:14420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b09160d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ccb expref: 5 pid: 15380 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843353.282820:0:14420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14420:1875737795731840:192.168.203.29@tcp:104: 00000100:00100000:3.0:1788843353.282929:0:14420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab71b0f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788843353.289735:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843353.289924:0:14420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14420:1875737795731840:192.168.203.29@tcp:104: 00010000:00010000:3.0:1788843353.289965:0:14420:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091616e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843353.290876:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775818752 00000100:00100000:0.0:1788843353.290885:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775818752 00010000:00010000:0.0:1788843353.290926:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b09160d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ccb expref: 6 pid: 15380 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843353.291149:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:0.0:1788843353.291160:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:2359:x1875737775818752:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843353.291189:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843353.291196:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b09160d4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ccb expref: 6 pid: 15380 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.291209:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b09160d4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ccb expref: 6 pid: 15380 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.291229:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b09160d4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084ccb expref: 6 pid: 15380 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.291250:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910200) 00010000:00010000:0.0:1788843353.291255:0:14405:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091616e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.291265:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091616e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.291272:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091616e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.291302:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843353.291399:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:57dd4253-596f-4283-9b4c-1047ff1bcc24+5:2359:x1875737775818752:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 241us (1674us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843353.291408:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00010000:00010000:3.0:1788843353.291474:0:14420:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091616e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.291482:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091616e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.291504:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916175 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.291513:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916175 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.291520:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916175 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843353.292817:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788843353.292833:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091616e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.292841:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091616e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.292848:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091616e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.292861:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799fe00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843353.292866:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091616e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.292873:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091616e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.292888:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910200) 00010000:00010000:3.0:1788843353.292892:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843353.292896:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091616e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.292901:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091616e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843353.292921:0:14420:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009465f419 reply state 00000000f43761a6 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916175 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843353.292928:0:14420:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788843353.293017:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+10:14437:x1875737775818624:12345-192.168.203.29@tcp:36:lfs.0 Request processed in 10965us (11136us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788843353.293026:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00010000:00010000:3.0:1788843353.306389:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916175 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.306408:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916175 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.306418:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916175 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.306444:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799f400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843353.306449:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916175 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.306456:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916175 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.306484:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dab43e63500) 00010000:00010000:3.0:1788843353.306488:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843353.306493:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916175 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.306499:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916175 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843353.392391:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843353.392542:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775818880 00000100:00100000:2.0:1788843353.392567:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775818880 00000100:00100000:2.0:1788843353.392627:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:2.0:1788843353.392638:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+9:14445:x1875737775818880:12345-192.168.203.29@tcp:101:lctl.0 00010000:00010000:2.0:1788843353.392662:0:15380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843353.392684:0:15380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b091617c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084cf5 expref: -99 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.392752:0:15380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0916183 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.392766:0:15380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0916183 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.392777:0:15380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0916183 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843353.392813:0:15380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788843353.392817:0:15380:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843353.392856:0:15380:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0916183 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.392880:0:15380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b091617c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084cf5 expref: 11 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.392898:0:15380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375a00/0xc6b8ac1b0916183 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084cf5 expref: 10 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.392908:0:15380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843353.392911:0:15380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788843353.392915:0:15380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375a00, rc 0) 00000100:00100000:2.0:1788843353.393138:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+10:14445:x1875737775818880:12345-192.168.203.29@tcp:101:lctl.0 Request processed in 501us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843353.393146:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:1.0:1788843353.451577:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843353.452540:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775819008 00000100:00100000:0.0:1788843353.452550:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775819008 00000100:00100000:0.0:1788843353.452622:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:0.0:1788843353.452633:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+5:14446:x1875737775819008:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1788843353.452670:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843353.452693:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b091618a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084cfc expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.452758:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916191 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.452773:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.452785:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843353.452820:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788843353.452823:0:14421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788843353.452844:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916191 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.452868:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b091618a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084cfc expref: 7 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.452888:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696a00/0xc6b8ac1b0916191 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084cfc expref: 6 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.452897:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:0.0:1788843353.452899:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788843353.452903:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42696a00, rc 0) 00000100:00100000:0.0:1788843353.452969:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:14446:x1875737775819008:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 338us (1400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843353.452977:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 21 00000100:00100000:1.0:1788843353.458118:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843353.458200:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775819136 00000100:00100000:3.0:1788843353.458210:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775819136 00000100:00100000:3.0:1788843353.458272:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:3.0:1788843353.458283:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:14446:x1875737775819136:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843353.458302:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843353.458335:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916198 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d03 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458421:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091619f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458436:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091619f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458447:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091619f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458473:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b09161a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458480:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b09161a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458487:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b09161a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458624:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09161ad lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458633:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09161ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458640:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09161ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843353.458670:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788843353.458675:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788843353.458692:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09161ad lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458716:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091619f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458724:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091619f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458730:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091619f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458748:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799fe00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843353.458752:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091619f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458759:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091619f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458770:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:3.0:1788843353.458773:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843353.458777:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091619f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458783:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b091619f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458796:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b09161a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458801:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b09161a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458807:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b09161a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458812:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799f200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843353.458815:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b09161a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458821:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b09161a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458839:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dab43e63500) 00010000:00010000:3.0:1788843353.458841:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843353.458845:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b09161a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458851:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b09161a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458882:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b0916198 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d03 expref: 8 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458897:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09161ad lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d03 expref: 7 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.458904:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:3.0:1788843353.458907:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843353.458909:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799e800, rc 0) 00000100:00100000:3.0:1788843353.458973:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57dd4253-596f-4283-9b4c-1047ff1bcc24+7:14446:x1875737775819136:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 691us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843353.458981:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 22 00000100:00100000:1.0:1788843353.469517:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843353.472585:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775819392 00000100:00100000:0.0:1788843353.472602:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775819392 00000100:00100000:0.0:1788843353.472738:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:0.0:1788843353.472749:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+7:14446:x1875737775819392:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1788843353.472769:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843353.472787:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b09161b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d0a expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843353.472876:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788843353.474550:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b09161b4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d0a expref: 9 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.474570:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:0.0:1788843353.474573:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788843353.474579:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b09161b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d0a expref: 9 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.474598:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42697e00, rc 0) 00000100:00100000:0.0:1788843353.474677:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+8:14446:x1875737775819392:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1929us (5168us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788843353.474685:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 23 00000100:00100000:1.0:1788843353.481227:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843353.481320:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775819648 00000100:00100000:3.0:1788843353.481365:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775819648 00000100:00100000:3.0:1788843353.481591:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:3.0:1788843353.481608:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57dd4253-596f-4283-9b4c-1047ff1bcc24+8:14446:x1875737775819648:12345-192.168.203.29@tcp:36:lfs.0 00010000:00010000:3.0:1788843353.481695:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843353.481731:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09161ad lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d03 expref: 8 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.481779:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:3.0:1788843353.481793:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843353.481826:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09161c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.481852:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09161c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.481863:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09161c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843353.482148:0:14422:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001ea1ce65 reply state 00000000a6b35180 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09161c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843353.482159:0:14422:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788843353.482167:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788843353.482278:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57dd4253-596f-4283-9b4c-1047ff1bcc24+9:14446:x1875737775819648:12345-192.168.203.29@tcp:36:lfs.0 Request processed in 674us (1059us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788843353.485242:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 24 00000100:00100000:2.0:1788843353.485441:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00010000:00010000:0.0:1788843353.485577:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09161c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.485590:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09161c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.485597:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09161c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.485619:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799f400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843353.485624:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09161c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.485631:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09161c2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.485647:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dab43e63500) 00010000:00010000:0.0:1788843353.485650:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788843353.485654:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09161c2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.485660:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f400/0xc6b8ac1b09161c2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843353.486083:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775819904 00000100:00100000:3.0:1788843353.486099:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775819904 00000100:00100000:3.0:1788843353.486168:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:3.0:1788843353.486183:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57dd4253-596f-4283-9b4c-1047ff1bcc24+8:14446:x1875737775819904:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:3.0:1788843353.486611:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57dd4253-596f-4283-9b4c-1047ff1bcc24+9:14446:x1875737775819904:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 431us (1178us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788843353.486628:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:1.0:1788843353.493029:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843353.493114:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775820160 00000100:00100000:3.0:1788843353.493143:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775820160 00000100:00100000:3.0:1788843353.493214:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:3.0:1788843353.493224:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57dd4253-596f-4283-9b4c-1047ff1bcc24+9:14446:x1875737775820160:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843353.493249:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843353.493271:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b09161c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d11 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.493707:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b09161d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.493724:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b09161d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.493739:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b09161d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498110:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09161d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498135:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09161d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498149:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09161d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843353.498284:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788843353.498614:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b09161d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498624:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b09161d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498630:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b09161d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498636:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7799fe00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843353.498640:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b09161d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498647:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b09161d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498660:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843353.498663:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843353.498681:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b09161d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498687:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799fe00/0xc6b8ac1b09161d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498701:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09161d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498707:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09161d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498712:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09161d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498718:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49374c00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843353.498720:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09161d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498726:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09161d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498735:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dab54910500) 00010000:00010000:2.0:1788843353.498737:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843353.498740:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09161d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498745:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09161d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498792:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b09161c9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d11 expref: 11 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498815:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843353.498817:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843353.498821:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799f200/0xc6b8ac1b09161c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d11 expref: 11 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.498831:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7799f200, rc 0) 00000100:00100000:2.0:1788843353.498908:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:57dd4253-596f-4283-9b4c-1047ff1bcc24+10:14446:x1875737775820160:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 5685us (5892us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788843353.498917:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 25 00000100:00100000:0.0:1788843353.502279:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843353.502479:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775820288 00000100:00100000:3.0:1788843353.502489:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775820288 00000100:00100000:3.0:1788843353.502533:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:3.0:1788843353.502544:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57dd4253-596f-4283-9b4c-1047ff1bcc24+10:14446:x1875737775820288:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843353.502569:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843353.502591:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09161e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d18 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.502679:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054000/0xc6b8ac1b09161ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.502694:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054000/0xc6b8ac1b09161ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.502704:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054000/0xc6b8ac1b09161ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843353.502745:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788843353.502750:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788843353.502783:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054000/0xc6b8ac1b09161ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.502809:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7799e800/0xc6b8ac1b09161e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d18 expref: 12 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.502827:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054000/0xc6b8ac1b09161ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d18 expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.502835:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:3.0:1788843353.502838:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788843353.502841:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82054000, rc 0) 00000100:00100000:3.0:1788843353.502897:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:57dd4253-596f-4283-9b4c-1047ff1bcc24+11:14446:x1875737775820288:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 355us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843353.502904:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 26 00000100:00100000:1.0:1788843353.517965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843353.518094:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775820416 00000100:00100000:0.0:1788843353.518107:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775820416 00000100:00100000:0.0:1788843353.518187:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:0.0:1788843353.518201:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+11:14446:x1875737775820416:12345-192.168.203.29@tcp:37:lfs.0 00000100:00100000:0.0:1788843353.525531:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+11:14446:x1875737775820416:12345-192.168.203.29@tcp:37:lfs.0 Request processed in 7259us (7506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843353.525549:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:1.0:1788843353.531073:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843353.531786:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775820672 00000100:00100000:3.0:1788843353.531802:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775820672 00000100:00100000:3.0:1788843353.531872:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:3.0:1788843353.531886:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c052450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57dd4253-596f-4283-9b4c-1047ff1bcc24+11:14446:x1875737775820672:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:3.0:1788843353.532225:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c052450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:57dd4253-596f-4283-9b4c-1047ff1bcc24+12:14446:x1875737775820672:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 340us (1177us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788843353.532234:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:1.0:1788843353.576179:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843353.576310:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775820800 00000100:00100000:0.0:1788843353.576324:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775820800 00000100:00100000:0.0:1788843353.576455:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:0.0:1788843353.576477:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+10:14452:x1875737775820800:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:0.0:1788843353.576504:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843353.576543:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b09161f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d1f expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.576632:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b09161fa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.576649:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b09161fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.576661:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b09161fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.576678:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916201 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.576686:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916201 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.576692:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916201 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.576816:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697800/0xc6b8ac1b0916208 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.576825:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697800/0xc6b8ac1b0916208 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.576832:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697800/0xc6b8ac1b0916208 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843353.576864:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788843353.576867:0:14421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788843353.576913:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697800/0xc6b8ac1b0916208 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.576935:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b09161fa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.576942:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b09161fa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.576950:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b09161fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.576957:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843353.576963:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b09161fa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.576971:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b09161fa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.576985:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:0.0:1788843353.576988:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843353.576993:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b09161fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.577000:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b09161fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.577016:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916201 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.577023:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916201 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.577029:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916201 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.577040:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42697000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843353.577043:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916201 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.577048:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916201 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.577068:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dab50f54300) 00010000:00010000:0.0:1788843353.577070:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843353.577073:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916201 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.577080:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916201 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.577117:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697e00/0xc6b8ac1b09161f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d1f expref: 12 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.577131:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697800/0xc6b8ac1b0916208 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d1f expref: 11 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.577138:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:0.0:1788843353.577140:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788843353.577143:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42697800, rc 0) 00000100:00100000:0.0:1788843353.577216:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+11:14452:x1875737775820800:12345-192.168.203.29@tcp:101:bash.0 Request processed in 751us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843353.577224:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 27 00000100:00100000:1.0:1788843353.585210:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843353.585337:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775821056 00000100:00100000:2.0:1788843353.585388:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775821056 00000100:00100000:2.0:1788843353.585477:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 28 00000100:00100000:2.0:1788843353.585491:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+11:14452:x1875737775821056:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:2.0:1788843353.585519:0:15380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843353.585548:0:15380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b091620f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d26 expref: -99 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.585732:0:15380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916216 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.585750:0:15380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054000/0xc6b8ac1b09161ec lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d18 expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.585761:0:15380:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916216 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.585806:0:15380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054000/0xc6b8ac1b09161ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d18 expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.585844:0:15380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054000/0xc6b8ac1b09161ec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d18 expref: 11 pid: 14422 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843353.585863:0:15380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ce73480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15380:1875737795731968:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843353.585999:0:15380:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51b15000 going to sleep for 11 seconds 00000100:00100000:2.0:1788843353.590835:0:15380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ce73480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15380:1875737795731968:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843353.590873:0:15380:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916216 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843353.595018:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843353.595424:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775821184 00000100:00100000:3.0:1788843353.595439:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775821184 00010000:00010000:2.0:1788843353.598066:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054000/0xc6b8ac1b09161ec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d18 expref: 12 pid: 14422 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843353.598154:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:2.0:1788843353.598168:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+12:2359:x1875737775821184:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843353.598193:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843353.598202:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054000/0xc6b8ac1b09161ec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d18 expref: 12 pid: 14422 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.598219:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054000/0xc6b8ac1b09161ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d18 expref: 12 pid: 14422 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.598251:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054000/0xc6b8ac1b09161ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d18 expref: 12 pid: 14422 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.598277:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:2.0:1788843353.598823:0:14406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916216 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.598837:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916216 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.598845:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916216 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.598891:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843353.598988:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc45f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:57dd4253-596f-4283-9b4c-1047ff1bcc24+11:2359:x1875737775821184:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 821us (3983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843353.598996:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00010000:00010000:1.0:1788843353.600383:0:15380:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916216 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843353.600404:0:15380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916216 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843353.600442:0:15380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091621d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843353.600744:0:15380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091621d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843353.600757:0:15380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091621d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843353.602983:0:15380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933aa00/0xc6b8ac1b0916224 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843353.603008:0:15380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933aa00/0xc6b8ac1b0916224 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843353.603021:0:15380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933aa00/0xc6b8ac1b0916224 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788843353.603035:0:15380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788843353.603083:0:15380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916216 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843353.603090:0:15380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916216 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843353.603098:0:15380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916216 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843353.603105:0:15380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375600 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843353.603110:0:15380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916216 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843353.603118:0:15380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916216 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843353.603154:0:15380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:1.0:1788843353.603158:0:15380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843353.603163:0:15380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916216 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843353.603169:0:15380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916216 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788843353.603187:0:15380:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000489e96 reply state 00000000563a949e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091621d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843353.603198:0:15380:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788843353.603249:0:15380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b091620f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d26 expref: 14 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843353.603267:0:15380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933aa00/0xc6b8ac1b0916224 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d26 expref: 13 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843353.603276:0:15380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:1.0:1788843353.603278:0:15380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788843353.603281:0:15380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab4933aa00, rc 0) 00000100:00100000:1.0:1788843353.603816:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+14:14452:x1875737775821056:12345-192.168.203.29@tcp:101:bash.0 Request processed in 18324us (18616us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788843353.603827:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 28 00010000:00010000:3.0:1788843353.605857:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091621d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.605878:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091621d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.605886:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091621d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.605892:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933a400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843353.605897:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091621d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.605905:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091621d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.605923:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8dab61f39700) 00010000:00010000:3.0:1788843353.605926:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843353.605931:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091621d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.605938:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091621d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843353.621076:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843353.621325:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775821312 00000100:00100000:0.0:1788843353.621407:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775821312 00000100:00100000:0.0:1788843353.621492:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:0.0:1788843353.621503:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+13:14452:x1875737775821312:12345-192.168.203.29@tcp:101:bash.0 00010000:00010000:0.0:1788843353.621543:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843353.621571:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916232 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d2d expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.621660:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b0916239 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.621678:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b0916239 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.621693:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b0916239 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843353.621743:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788843353.621749:0:14421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788843353.621773:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b0916239 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.621786:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b0916239 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.621816:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b0916232 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d2d expref: 15 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.621840:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b0916239 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d2d expref: 14 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.621851:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:0.0:1788843353.621861:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843353.621866:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42696000, rc 0) 00000100:00100000:0.0:1788843353.621934:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+14:14452:x1875737775821312:12345-192.168.203.29@tcp:101:bash.0 Request processed in 433us (886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843353.621943:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 29 00000100:00100000:1.0:1788843353.626088:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843353.626197:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775821568 00000100:00100000:3.0:1788843353.626210:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775821568 00000100:00100000:3.0:1788843353.626286:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:3.0:1788843353.626300:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+14:14452:x1875737775821568:12345-192.168.203.29@tcp:35:bash.0 00000100:00100000:3.0:1788843353.627084:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+15:14452:x1875737775821568:12345-192.168.203.29@tcp:35:bash.0 Request processed in 781us (1003us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788843353.627117:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00010000:00010000:1.0:1788843353.668706:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788843353.719898:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843353.720145:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775821824 00000100:00100000:3.0:1788843353.720159:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775821824 00000100:00100000:3.0:1788843353.720255:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:3.0:1788843353.720267:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7bc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+15:14462:x1875737775821824:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:3.0:1788843353.720302:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843353.720333:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0916240 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d34 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843353.720512:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788843353.722098:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0916240 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d34 expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.722125:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dab54910d00) 00010000:00010000:2.0:1788843353.722129:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843353.722135:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055000/0xc6b8ac1b0916240 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d34 expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843353.722159:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82055000, rc 0) 00000100:00100000:2.0:1788843353.722257:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7bc46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+16:14462:x1875737775821824:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1992us (2375us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1788843353.722266:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:3.0:1788843353.729518:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843353.729718:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775822080 00000100:00100000:0.0:1788843353.729732:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775822080 00000100:00100000:0.0:1788843353.729825:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:0.0:1788843353.729838:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+16:14462:x1875737775822080:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:0.0:1788843353.730179:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e848a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+17:14462:x1875737775822080:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 342us (675us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788843353.730187:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:1.0:1788843353.796319:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843353.796876:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775822336 00000100:00100000:0.0:1788843353.796889:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775822336 00000100:00100000:0.0:1788843353.796971:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:0.0:1788843353.796984:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+17:14465:x1875737775822336:12345-192.168.203.29@tcp:101:lfs.0 00010000:00010000:0.0:1788843353.797018:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788843353.797045:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091624e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d3b expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.797187:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916255 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.797205:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916255 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.797223:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916255 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788843353.797251:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788843353.797900:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091624e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d3b expref: 20 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.797932:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916255 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d3b expref: 19 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.797942:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:0.0:1788843353.797945:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843353.797949:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42696600, rc 0) 00000100:00100000:0.0:1788843353.798105:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+19:14465:x1875737775822336:12345-192.168.203.29@tcp:101:lfs.0 Request processed in 1123us (1802us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788843353.798115:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:1.0:1788843353.805687:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843353.805982:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775822464 00000100:00100000:0.0:1788843353.805996:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775822464 00000100:00100000:0.0:1788843353.806102:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:0.0:1788843353.806115:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+19:2357:x1875737775822464:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843353.806137:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843353.806172:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916255 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d3b expref: 19 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843353.806200:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:0.0:1788843353.806207:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843353.806288:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+18:2357:x1875737775822464:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 175us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843353.806297:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:3.0:1788843353.807127:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843353.808855:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775822592 00000100:00100000:2.0:1788843353.808874:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775822592 00000100:00100000:3.0:1788843353.809898:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:3.0:1788843353.810116:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+18:14465:x1875737775822592:12345-192.168.203.29@tcp:54:lfs.0 00010000:00010000:3.0:1788843353.810457:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054600/0xc6b8ac1b0916263 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.810555:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054600/0xc6b8ac1b0916263 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.810572:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054600/0xc6b8ac1b0916263 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.810611:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054600/0xc6b8ac1b0916263 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.810619:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054600/0xc6b8ac1b0916263 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.810674:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054600/0xc6b8ac1b0916263 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.810682:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054600 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843353.810687:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054600/0xc6b8ac1b0916263 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.810696:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054600/0xc6b8ac1b0916263 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.810711:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:3.0:1788843353.810715:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788843353.810720:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054600/0xc6b8ac1b0916263 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843353.810727:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054600/0xc6b8ac1b0916263 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843353.811946:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+18:14465:x1875737775822592:12345-192.168.203.29@tcp:54:lfs.0 Request processed in 2022us (4811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843353.811962:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 32 00000100:00100000:1.0:1788843353.827545:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843353.827764:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775822848 00000100:00100000:0.0:1788843353.827779:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775822848 00000100:00100000:0.0:1788843353.827868:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:0.0:1788843353.827882:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+18:14465:x1875737775822848:12345-192.168.203.29@tcp:35:lfs.0 00000100:00100000:0.0:1788843353.828852:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+19:14465:x1875737775822848:12345-192.168.203.29@tcp:35:lfs.0 Request processed in 966us (1316us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788843353.828863:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:1.0:1788843354.177952:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843354.178086:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775823104 00000100:00100000:2.0:1788843354.178103:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775823104 00000100:00080000:3.0:1788843354.178222:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788843354.178452:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:2.0:1788843354.178491:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+19:14496:x1875737775823104:12345-192.168.203.29@tcp:101:cat.0 00010000:00010000:2.0:1788843354.178526:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843354.178554:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b091626a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d42 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.178689:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916271 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.178708:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916271 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.178722:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916271 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843354.178735:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788843354.178923:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b091626a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d42 expref: 22 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.178948:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916271 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d42 expref: 21 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.178959:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:2.0:1788843354.178962:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788843354.178966:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374200, rc 0) 00000100:00100000:2.0:1788843354.179072:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+21:14496:x1875737775823104:12345-192.168.203.29@tcp:101:cat.0 Request processed in 587us (1127us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1788843354.183517:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843354.185593:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775823232 00000100:00100000:1.0:1788843354.185615:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775823232 00000100:00100000:1.0:1788843354.185744:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:1.0:1788843354.185757:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+22:2358:x1875737775823232:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788843354.185778:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788843354.185816:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916271 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d42 expref: 22 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843354.185845:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:1.0:1788843354.185852:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788843354.185937:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+21:2358:x1875737775823232:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 179us (2427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843354.185946:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:3.0:1788843354.186391:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843354.186561:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775823488 00000100:00100000:0.0:1788843354.186571:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775823488 00000100:00100000:0.0:1788843354.186639:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:0.0:1788843354.186650:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+21:14496:x1875737775823488:12345-192.168.203.29@tcp:35:cat.0 00000040:00080000:1.0:1788843354.186976:0:14455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788843354.187174:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 33 00000100:00100000:0.0:1788843354.187840:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+21:14496:x1875737775823488:12345-192.168.203.29@tcp:35:cat.0 Request processed in 1184us (1878us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1788843354.187850:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 8 00000100:00100000:1.0:1788843354.267657:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843354.267773:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775823744 00000100:00100000:2.0:1788843354.267787:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775823744 00000100:00100000:2.0:1788843354.267907:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:2.0:1788843354.267920:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+21:14502:x1875737775823744:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:2.0:1788843354.267954:0:15380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843354.267982:0:15380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b091627f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d49 expref: -99 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.268155:0:15380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916286 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.268174:0:15380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933aa00/0xc6b8ac1b0916224 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d26 expref: 22 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.268182:0:15380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b0916239 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d2d expref: 22 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.268190:0:15380:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916286 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.268233:0:15380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b0916239 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d2d expref: 22 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.268247:0:15380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b0916239 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d2d expref: 22 pid: 14421 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843354.268263:0:15380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ce73480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15380:1875737795732096:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843354.268435:0:15380:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933aa00/0xc6b8ac1b0916224 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d26 expref: 22 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.268458:0:15380:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933aa00/0xc6b8ac1b0916224 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d26 expref: 22 pid: 15380 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843354.268468:0:15380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ce73800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15380:1875737795732224:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843354.268498:0:15380:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51b15cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788843354.274270:0:15380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ce73480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15380:1875737795732096:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843354.274337:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843354.274547:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775823872 00000100:00100000:2.0:1788843354.274556:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775823872 00010000:00010000:2.0:1788843354.277135:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b0916239 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d2d expref: 23 pid: 14421 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843354.277209:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:2.0:1788843354.277223:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6002f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+23:2358:x1875737775823872:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788843354.277243:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843354.277252:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b0916239 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d2d expref: 23 pid: 14421 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.277271:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b0916239 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d2d expref: 23 pid: 14421 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.277302:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696000/0xc6b8ac1b0916239 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d2d expref: 23 pid: 14421 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.277324:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:2.0:1788843354.277660:0:14407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916286 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.277690:0:14407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916286 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.277700:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843354.278115:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6002f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+22:2358:x1875737775823872:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 891us (3775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843354.278126:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:1.0:1788843354.285371:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843354.285502:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775824000 00000100:00100000:0.0:1788843354.285514:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775824000 00010000:00010000:0.0:1788843354.285580:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933aa00/0xc6b8ac1b0916224 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d26 expref: 22 pid: 15380 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843354.285632:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 12 00000100:00100000:0.0:1788843354.285643:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+22:2359:x1875737775824000:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843354.285694:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843354.285703:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933aa00/0xc6b8ac1b0916224 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d26 expref: 22 pid: 15380 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843354.285717:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933aa00/0xc6b8ac1b0916224 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d26 expref: 22 pid: 15380 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843354.285752:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:0.0:1788843354.285759:0:14405:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916286 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843354.285771:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916286 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843354.285780:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916286 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843354.285804:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843354.285862:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+22:2359:x1875737775824000:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 220us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843354.285870:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 12 00010000:00010000:2.0:1788843354.286125:0:15380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933aa00/0xc6b8ac1b0916224 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d26 expref: 21 pid: 15380 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843354.286146:0:15380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ce73800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15380:1875737795732224:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843354.286175:0:15380:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916286 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.286186:0:15380:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916286 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.286192:0:15380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916286 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843354.286216:0:15380:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788843354.286459:0:15380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b091627f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d49 expref: 22 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.286478:0:15380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374200/0xc6b8ac1b0916286 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d49 expref: 21 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.286486:0:15380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:2.0:1788843354.286500:0:15380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788843354.286504:0:15380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374200, rc 0) 00000100:00100000:2.0:1788843354.286540:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+21:14502:x1875737775823744:12345-192.168.203.29@tcp:101:dd.0 Request processed in 18623us (18899us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788843354.286548:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 34 00000100:00100000:3.0:1788843354.289742:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843354.290633:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775824256 00000100:00100000:0.0:1788843354.290652:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775824256 00000100:00100000:0.0:1788843354.290745:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 35 00000100:00100000:0.0:1788843354.290759:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+21:14502:x1875737775824256:12345-192.168.203.29@tcp:36:dd.0 00010000:00010000:0.0:1788843354.291545:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916294 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843354.291572:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916294 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843354.291587:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916294 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843354.291660:0:14421:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788843354.291705:0:14421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000159a6331 reply state 00000000514ab8ff transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916294 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843354.291743:0:14421:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788843354.292831:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+24:14502:x1875737775824256:12345-192.168.203.29@tcp:36:dd.0 Request processed in 1579us (2606us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788843354.292847:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 35 00000020:00080000:0.0:1788843354.292856:0:14421:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788843354.294124:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916294 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843354.294142:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916294 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843354.294150:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916294 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843354.294178:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696600 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:1.0:1788843354.294184:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916294 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843354.294193:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916294 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843354.294216:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:1.0:1788843354.294219:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788843354.294225:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916294 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843354.294232:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916294 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843354.296884:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843354.296980:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775824384 00000100:00100000:3.0:1788843354.296993:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775824384 00000100:00100000:3.0:1788843354.297070:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:3.0:1788843354.297083:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+23:14502:x1875737775824384:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:3.0:1788843354.297135:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843354.297162:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054600/0xc6b8ac1b091629b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d50 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843354.297239:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054600/0xc6b8ac1b091629b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d50 expref: 24 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843354.297255:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054600/0xc6b8ac1b091629b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d50 expref: 24 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843354.297276:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:3.0:1788843354.297279:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788843354.297284:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab82054600, rc 0) 00000100:00100000:3.0:1788843354.297376:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+24:14502:x1875737775824384:12345-192.168.203.29@tcp:101:dd.0 Request processed in 296us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843354.297384:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 36 00000100:00100000:3.0:1788843354.309900:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843354.310014:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775824640 00000100:00100000:2.0:1788843354.310028:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775824640 00000100:00100000:2.0:1788843354.310130:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:2.0:1788843354.310143:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+24:14502:x1875737775824640:12345-192.168.203.29@tcp:103:dd.0 00010000:00010000:2.0:1788843354.310164:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843354.310210:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054600/0xc6b8ac1b091629b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d50 expref: 24 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.310238:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:2.0:1788843354.310245:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788843354.310323:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e84bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+23:14502:x1875737775824640:12345-192.168.203.29@tcp:103:dd.0 Request processed in 182us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843354.310332:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:1.0:1788843354.317094:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843354.319572:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775824768 00000100:00100000:2.0:1788843354.319591:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775824768 00000100:00100000:2.0:1788843354.320650:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:2.0:1788843354.320673:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+23:14502:x1875737775824768:12345-192.168.203.29@tcp:58:dd.0 00010000:00010000:2.0:1788843354.320809:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09162a2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.320832:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09162a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.320872:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09162a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788843354.322152:0:14420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788843354.322403:0:14420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788843354.322572:0:14420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788843354.322748:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+23:14502:x1875737775824768:12345-192.168.203.29@tcp:58:dd.0 Request processed in 2077us (5666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843354.322761:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 37 00000100:00100000:1.0:1788843354.335903:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843354.336516:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775824896 00000100:00100000:2.0:1788843354.336529:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775824896 00000100:00100000:2.0:1788843354.336624:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 38 00000100:00100000:2.0:1788843354.336637:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+23:14502:x1875737775824896:12345-192.168.203.29@tcp:101:dd.0 00010000:00010000:2.0:1788843354.336665:0:15380:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843354.336701:0:15380:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09162a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d57 expref: -99 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.336955:0:15380:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09162a2 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.336969:0:15380:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09162a9 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d57 expref: 24 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.336999:0:15380:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09162a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.337014:0:15380:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09162a9 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d57 expref: 24 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.337062:0:15380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:2.0:1788843354.337066:0:15380:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788843354.337072:0:15380:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09162a9 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d57 expref: 24 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843354.337080:0:15380:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374c00, rc 0) 00000100:00100000:2.0:1788843354.337172:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+24:14502:x1875737775824896:12345-192.168.203.29@tcp:101:dd.0 Request processed in 538us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843354.337180:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 38 00010000:00010000:0.0:1788843354.697687:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843354.954227:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ffb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795732352:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788843354.954337:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843354.955417:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795732352 00000100:00100000:1.0:1788843354.955432:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795732352 00000100:00100000:1.0:1788843354.955538:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788843354.955551:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795732352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788843354.955604:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843354.955690:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795732352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843354.955699:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788843354.956062:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ffb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795732352:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788843354.956995:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1788843355.209185:0:14455:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788843355.209199:0:14455:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843355.209268:0:14455:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788843355.209276:0:14455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1788843355.209492:0:14455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6eb29500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14455:1875737795732480:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788843355.209682:0:14455:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab54088000 going to sleep for 11 seconds 00000100:00100000:0.0:1788843355.216410:0:14455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6eb29500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14455:1875737795732480:192.168.203.29@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788843355.221763:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843355.221981:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775825024 00000100:00100000:3.0:1788843355.221995:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775825024 00000100:00100000:3.0:1788843355.222099:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:3.0:1788843355.222112:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b87c6d43-928f-4231-aaff-6c642a37da7f+24:14503:x1875737775825024:12345-192.168.203.29@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788843355.226369:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b87c6d43-928f-4231-aaff-6c642a37da7f+24:14503:x1875737775825024:12345-192.168.203.29@tcp:900:lhsmtool_posix.0 Request processed in 4205us (4567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843355.226391:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:1.0:1788843355.231155:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843355.231302:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775825152 00000100:00100000:3.0:1788843355.231315:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775825152 00000100:00100000:3.0:1788843355.231555:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:3.0:1788843355.231789:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+24:14503:x1875737775825152:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788843355.231836:0:14421:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788843355.234338:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+24:14503:x1875737775825152:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 2533us (3181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843355.234378:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 39 00000100:00100000:0.0:1788843355.238942:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843355.239094:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775825280 00000100:00100000:3.0:1788843355.239109:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775825280 00000100:00100000:3.0:1788843355.239175:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:3.0:1788843355.239187:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+24:14503:x1875737775825280:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788843355.239271:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054a00/0xc6b8ac1b09162b0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239289:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054a00/0xc6b8ac1b09162b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239304:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054a00/0xc6b8ac1b09162b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239651:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09162b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239662:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09162b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239673:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09162b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239700:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09162be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239730:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09162be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239739:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09162be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788843355.239782:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788843355.239787:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788843355.239800:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09162be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239812:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054a00/0xc6b8ac1b09162b0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239819:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054a00/0xc6b8ac1b09162b0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239826:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054a00/0xc6b8ac1b09162b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239832:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054a00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843355.239836:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054a00/0xc6b8ac1b09162b0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239845:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054a00/0xc6b8ac1b09162b0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239857:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab43e63800) 00010000:00010000:3.0:1788843355.239861:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843355.239867:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054a00/0xc6b8ac1b09162b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239884:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054a00/0xc6b8ac1b09162b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239903:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09162b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239910:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09162b7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239984:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09162b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239989:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843355.239993:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09162b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.239999:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09162b7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.240007:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8dab43e63b00) 00010000:00010000:3.0:1788843355.240010:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843355.240013:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09162b7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.240020:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b09162b7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.240037:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09162be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.240053:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09162be lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.240066:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09162be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.240071:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055800 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843355.240074:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09162be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.240079:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09162be lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.240087:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:3.0:1788843355.240090:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788843355.240093:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09162be lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.240097:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09162be lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843355.240190:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+24:14503:x1875737775825280:12345-192.168.203.29@tcp:34:lhsmtool_posix.0 Request processed in 1004us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843355.240200:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 40 00000100:00100000:0.0:1788843355.242700:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843355.242837:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775825536 00000100:00100000:2.0:1788843355.242851:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775825536 00000100:00100000:2.0:1788843355.242930:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:2.0:1788843355.242942:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ffb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+24:14503:x1875737775825536:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843355.242970:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843355.242998:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b09162c5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d5e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.243210:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162cc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.243232:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.243270:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843355.243284:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788843355.243764:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162cc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.243775:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162cc lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.243783:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.243789:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375c00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843355.243794:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162cc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.243802:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162cc lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.243817:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:2.0:1788843355.243820:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788843355.243826:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162cc lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.243833:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162cc lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.243884:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b09162c5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d5e expref: 26 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.243907:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dab43e63800) 00010000:00010000:2.0:1788843355.243909:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788843355.243913:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b09162c5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d5e expref: 26 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.243922:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375600, rc 0) 00000100:00100000:2.0:1788843355.243999:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ffb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+25:14503:x1875737775825536:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 1060us (1314us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788843355.244008:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 41 00000100:00100000:1.0:1788843355.248517:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843355.248597:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775825664 00000100:00100000:2.0:1788843355.248612:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775825664 00000100:00100000:2.0:1788843355.248690:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:2.0:1788843355.248702:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+25:14503:x1875737775825664:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788843355.248763:0:15380:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788843355.249128:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+25:14503:x1875737775825664:12345-192.168.203.29@tcp:53:lhsmtool_posix.0 Request processed in 426us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843355.249138:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 42 00000100:00100000:0.0:1788843355.253794:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843355.253948:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775825920 00000100:00100000:3.0:1788843355.254050:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775825920 00000100:00100000:3.0:1788843355.254135:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:3.0:1788843355.254148:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+25:14503:x1875737775825920:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788843355.254175:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788843355.254204:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09162da lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d65 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788843355.255681:0:14421:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1788843355.255694:0:14421:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788843355.255753:0:14421:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788843355.256106:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697400/0xc6b8ac1b09162e1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.256126:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697400/0xc6b8ac1b09162e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.256139:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697400/0xc6b8ac1b09162e1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.256219:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82055800/0xc6b8ac1b09162da lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d65 expref: 28 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.256244:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697400/0xc6b8ac1b09162e1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d65 expref: 27 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.256262:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dab50f54300) 00010000:00010000:0.0:1788843355.256266:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788843355.256270:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8daa42697400, rc 0) 00000100:00100000:0.0:1788843355.256392:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+27:14503:x1875737775825920:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 2245us (2611us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788843355.256403:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 43 00000100:00100000:0.0:1788843355.260287:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843355.266010:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775826176 00000100:00100000:3.0:1788843355.266034:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775826176 00000100:00100000:2.0:1788843355.266868:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:2.0:1788843355.266883:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+27:14503:x1875737775826176:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788843355.266959:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788843355.266994:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697400/0xc6b8ac1b09162e1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d65 expref: 27 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267019:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dab50f54300) 00010000:00010000:2.0:1788843355.267063:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788843355.267103:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b09162ef lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267118:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b09162ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267129:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b09162ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267144:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162f6 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x28b88bc0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267152:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x28b88bc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267159:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x28b88bc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267247:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b09162ef lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267253:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b09162ef lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267260:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b09162ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267267:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375600 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843355.267271:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b09162ef lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267279:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b09162ef lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267296:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dab43e63700) 00010000:00010000:2.0:1788843355.267299:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843355.267304:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b09162ef lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267310:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b09162ef lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267320:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162f6 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x28b88bc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267326:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162f6 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x28b88bc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267331:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x28b88bc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267337:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375c00 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:2.0:1788843355.267645:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162f6 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x28b88bc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267657:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162f6 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x28b88bc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267665:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x28b88bc0 (ffff8dab54910500) 00010000:00010000:2.0:1788843355.267668:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788843355.267671:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162f6 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x28b88bc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.267676:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b09162f6 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x28b88bc0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843355.267852:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+26:14503:x1875737775826176:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 969us (7577us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788843355.267862:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 44 00000100:00100000:1.0:1788843355.277001:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843355.277771:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775826304 00000100:00100000:2.0:1788843355.277790:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775826304 00000100:00100000:2.0:1788843355.277867:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:2.0:1788843355.277880:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+26:14503:x1875737775826304:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843355.277909:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843355.277940:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b09162fd lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d6c expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.277989:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0916304 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.278007:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0916304 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.278021:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0916304 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.278177:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b09162fd lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d6c expref: 28 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.278213:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374e00/0xc6b8ac1b0916304 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d6c expref: 27 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.278224:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:2.0:1788843355.278236:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788843355.278242:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49374e00, rc 0) 00000100:00100000:2.0:1788843355.278337:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+27:14503:x1875737775826304:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 458us (1348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843355.278386:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 45 00000100:00100000:0.0:1788843355.285846:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843355.285963:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775826560 00000100:00100000:1.0:1788843355.285977:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775826560 00000100:00100000:1.0:1788843355.286062:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 46 00000100:00100000:1.0:1788843355.286083:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+27:14503:x1875737775826560:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788843355.286200:0:15380:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091630b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.286221:0:15380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091630b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.286237:0:15380:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091630b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788843355.287016:0:15380:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1788843355.287032:0:15380:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 479537689856ns, next at 480537686524ns, rc = 0 00000004:00010000:1.0:1788843355.288317:0:15380:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e90dbf4 reply state 000000002d04e476 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091630b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843355.288338:0:15380:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788843355.288999:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+29:14503:x1875737775826560:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 2908us (3160us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788843355.289012:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 46 00010000:00010000:3.0:1788843355.304233:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091630b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.304257:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091630b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.304266:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091630b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.304272:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933a400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:3.0:1788843355.304278:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091630b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.304287:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091630b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.304308:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:3.0:1788843355.304311:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788843355.304317:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091630b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.304323:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933a400/0xc6b8ac1b091630b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15380 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843355.306970:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843355.307310:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775826688 00000100:00100000:2.0:1788843355.307323:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775826688 00000100:00100000:2.0:1788843355.307425:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:2.0:1788843355.307438:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+28:14503:x1875737775826688:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843355.307476:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843355.307507:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916312 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d73 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.308426:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916312 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d73 expref: 29 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.308785:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916312 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d73 expref: 29 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.308823:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:2.0:1788843355.308827:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788843355.308832:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab49375c00, rc 0) 00000100:00100000:2.0:1788843355.308949:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+29:14503:x1875737775826688:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 1512us (1992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843355.308959:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 47 00000100:00100000:1.0:1788843355.313206:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843355.313393:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775826816 00000100:00100000:2.0:1788843355.313411:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775826816 00000100:00100000:2.0:1788843355.313547:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:2.0:1788843355.313727:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2359:x1875737775826816:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788843355.314737:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788843355.314895:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+6:2359:x1875737775826816:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 1330us (1698us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788843355.314906:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:1.0:1788843355.319274:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843355.319407:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775827072 00000100:00100000:0.0:1788843355.319421:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775827072 00000100:00100000:0.0:1788843355.319790:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:0.0:1788843355.319803:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+29:14503:x1875737775827072:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788843355.320135:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+30:14503:x1875737775827072:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 334us (1114us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788843355.320144:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 9 00000100:00100000:3.0:1788843355.324543:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843355.324648:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775827328 00000100:00100000:2.0:1788843355.324662:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775827328 00000100:00100000:2.0:1788843355.324742:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:2.0:1788843355.324753:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+30:14503:x1875737775827328:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788843355.324907:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e848700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+30:14503:x1875737775827328:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 156us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843355.324916:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 48 00000100:00100000:1.0:1788843355.329061:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843355.329260:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775827456 00000100:00100000:0.0:1788843355.329274:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775827456 00000100:00100000:2.0:1788843355.329600:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:2.0:1788843355.329625:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+30:14503:x1875737775827456:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843355.329655:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843355.329685:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916319 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d7a expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.330008:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89a00/0xc6b8ac1b0916320 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.330027:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89a00/0xc6b8ac1b0916320 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.330039:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89a00/0xc6b8ac1b0916320 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788843355.330130:0:14420:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788843355.330154:0:14420:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89a00/0xc6b8ac1b0916320 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.330199:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375600/0xc6b8ac1b0916319 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d7a expref: 32 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.330221:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89a00/0xc6b8ac1b0916320 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d7a expref: 31 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.330231:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:2.0:1788843355.330235:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788843355.330239:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89a00, rc 0) 00000100:00100000:2.0:1788843355.330326:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+31:14503:x1875737775827456:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 706us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843355.330334:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 49 00000100:00100000:3.0:1788843355.334987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843355.335169:0:16114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775827584 00000100:00100000:2.0:1788843355.335182:0:16114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775827584 00000100:00100000:2.0:1788843355.335291:0:16114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:2.0:1788843355.335304:0:16114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+6:2359:x1875737775827584:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843355.335328:0:16114:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843355.335394:0:16114:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecfd5f3c/0xc6b8ac1b0916327 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d81 expref: -99 pid: 16114 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788843355.335431:0:16114:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f955b, blocks: 0x1 00010000:00010000:2.0:1788843355.335469:0:16114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=479s v=(0 0) 00010000:00010000:2.0:1788843355.335493:0:16114:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843355.335506:0:16114:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecfd5f3c/0xc6b8ac1b0916327 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d81 expref: 7 pid: 16114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.335547:0:16114:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ecfd5f3c/0xc6b8ac1b0916327 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d81 expref: 7 pid: 16114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.335566:0:16114:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89600, rc 0) 00000100:00100000:2.0:1788843355.336061:0:16114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+7:2359:x1875737775827584:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 758us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843355.336078:0:16114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:3.0:1788843355.340653:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843355.341251:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775827840 00000100:00100000:2.0:1788843355.341266:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775827840 00000100:00100000:2.0:1788843355.341380:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:2.0:1788843355.341393:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+31:14503:x1875737775827840:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788843355.341875:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e848000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+31:14503:x1875737775827840:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 480us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843355.341885:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 50 00000100:00100000:1.0:1788843355.346488:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843355.346782:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775827968 00000100:00100000:3.0:1788843355.346817:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775827968 00000100:00100000:3.0:1788843355.346898:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:3.0:1788843355.346910:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+31:14503:x1875737775827968:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788843355.402877:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:1.0:1788843355.402916:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934595 is committed 00000004:00080000:1.0:1788843355.402928:0:5868:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788843355.402970:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1788843355.402981:0:5868:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788843355.403270:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788843355.403298:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ce73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795732608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788843355.403420:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843355.403515:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795732608 00000100:00100000:2.0:1788843355.403525:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795732608 00000100:00100000:2.0:1788843355.403595:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788843355.403829:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1875737795732608:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788843355.404033:0:15105:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788843355.404064:0:15105:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788843355.404214:0:15105:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788843355.404217:0:15105:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788843355 -> 1788843355 00002000:00010000:2.0:1788843355.404219:0:15105:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788843355.404330:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875737795732608:12345-0@lo:2:osp-syn-0-0.0 Request processed in 724us (909us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788843355.404363:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788843355.404585:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+14:14503:x1875737775827968:12345-192.168.203.29@tcp:44:lhsmtool_posix.0 Request processed in 57674us (58111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843355.404596:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 51 00000100:00100000:3.0:1788843355.407709:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843355.408221:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775828096 00000100:00100000:0.0:1788843355.408235:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775828096 00000100:00100000:0.0:1788843355.408300:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 16 00000100:00100000:0.0:1788843355.408311:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+7:2358:x1875737775828096:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788843355.408499:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e849c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+7:2358:x1875737775828096:12345-192.168.203.29@tcp:16:lhsmtool_posix.0 Request processed in 187us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843355.408542:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 16 00000004:00080000:1.0:1788843355.409460:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dab7ce73480/2, rc 0, transno 8589934595 00000100:00100000:1.0:1788843355.409474:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ce73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1875737795732608:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788843355.412860:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843355.413274:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775828352 00000100:00100000:3.0:1788843355.413287:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775828352 00000100:00100000:3.0:1788843355.413381:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:3.0:1788843355.413396:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+14:14503:x1875737775828352:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788843355.413472:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843355.413510:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff89a00/0xc6b8ac1b0916320 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d7a expref: 14 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.413545:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:3.0:1788843355.413553:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788843355.413600:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b091632e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.413619:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b091632e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.413631:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b091632e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788843355.414746:0:14422:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000449d13b reply state 000000002d4e656e transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b091632e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843355.414908:0:14422:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788843355.415182:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+15:14503:x1875737775828352:12345-192.168.203.29@tcp:36:lhsmtool_posix.0 Request processed in 1784us (2339us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788843355.415192:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 52 00000100:00100000:1.0:1788843355.420185:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843355.421258:0:15105:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775828480 00000100:00100000:2.0:1788843355.421276:0:15105:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775828480 00000100:00100000:2.0:1788843355.421382:0:15105:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:2.0:1788843355.421395:0:15105:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+7:14503:x1875737775828480:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788843355.421420:0:15105:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788843355.421445:0:15105:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f31c5a3/0xc6b8ac1b0916335 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x34e059c607084d88 expref: -99 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.421622:0:15105:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ecfd5f3c/0xc6b8ac1b0916327 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d81 expref: 8 pid: 16114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.421634:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843355.421640:0:15105:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843355.421646:0:15105:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f31c5a3/0xc6b8ac1b0916335 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d88 expref: 8 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.421693:0:15105:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ecfd5f3c/0xc6b8ac1b0916327 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d81 expref: 8 pid: 16114 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.421731:0:15105:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ecfd5f3c/0xc6b8ac1b0916327 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d81 expref: 8 pid: 16114 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843355.421749:0:15105:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ce71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15105:1875737795732736:192.168.203.29@tcp:104: 00000100:00100000:2.0:1788843355.423075:0:15105:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51b15c00 going to sleep for 11 seconds 00010000:00010000:0.0:1788843355.423227:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b091632e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.423242:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b091632e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.423252:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b091632e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.423259:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054200 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843355.423266:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b091632e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.423276:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b091632e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.423296:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:0.0:1788843355.423300:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843355.423305:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b091632e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.423311:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab82054200/0xc6b8ac1b091632e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843355.428551:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843355.428624:0:15105:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ce71f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:15105:1875737795732736:192.168.203.29@tcp:104: 00010000:00010000:2.0:1788843355.428676:0:15105:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008f31c5a3/0xc6b8ac1b0916335 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d88 expref: 8 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.428706:0:15105:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dab7ff89400, rc 0) 00000100:00100000:3.0:1788843355.428715:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775828608 00000100:00100000:3.0:1788843355.428726:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775828608 00010000:00010000:3.0:1788843355.428775:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ecfd5f3c/0xc6b8ac1b0916327 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d81 expref: 9 pid: 16114 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843355.428906:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:3.0:1788843355.428919:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+9:2358:x1875737775828608:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843355.428940:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843355.428969:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ecfd5f3c/0xc6b8ac1b0916327 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d81 expref: 9 pid: 16114 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.428985:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ecfd5f3c/0xc6b8ac1b0916327 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d81 expref: 9 pid: 16114 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.429019:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecfd5f3c/0xc6b8ac1b0916327 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d81 expref: 9 pid: 16114 timeout: 579 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.429036:0:14406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843355.429051:0:14406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843355.429064:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f31c5a3/0xc6b8ac1b0916335 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d88 expref: 8 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.429100:0:14406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f31c5a3/0xc6b8ac1b0916335 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d88 expref: 8 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.429145:0:14406:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008f31c5a3/0xc6b8ac1b0916335 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d88 expref: 8 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843355.429163:0:15105:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+8:14503:x1875737775828480:12345-192.168.203.29@tcp:101:lhsmtool_posix.0 Request processed in 7769us (8992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843355.429165:0:14406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab6e84ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14406:1875737795732864:192.168.203.29@tcp:105: 00000100:00100000:2.0:1788843355.429180:0:15105:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:3.0:1788843355.429238:0:14406:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab71b0f480 going to sleep for 11 seconds 00000100:00100000:3.0:1788843355.433695:0:14406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab6e84ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14406:1875737795732864:192.168.203.29@tcp:105: 00010000:00010000:3.0:1788843355.433731:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843355.435293:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+7:2358:x1875737775828608:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 6363us (6745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843355.435309:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 13 00000100:00100000:1.0:1788843355.435988:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843355.436964:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775828736 00000100:00100000:0.0:1788843355.436979:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775828736 00000100:00100000:0.0:1788843355.437064:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:0.0:1788843355.437198:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6eb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+7:2358:x1875737775828736:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788843355.437493:0:15107:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788843355.437515:0:15107:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788843354 00002000:00010000:0.0:1788843355.437518:0:15107:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788843353 00002000:00010000:0.0:1788843355.437521:0:15107:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788843355 -> 1788843354 00002000:00010000:0.0:1788843355.437523:0:15107:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788843355.437630:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6eb29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+8:2358:x1875737775828736:12345-192.168.203.29@tcp:2:lhsmtool_posix.0 Request processed in 434us (1645us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788843355.439723:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:2.0:1788843355.441229:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843355.441451:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775828864 00000100:00100000:1.0:1788843355.441533:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775828864 00000100:00100000:1.0:1788843355.441757:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:1.0:1788843355.441780:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+8:2356:x1875737775828864:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788843355.441844:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e3e8f20b/0xc6b8ac1b091633c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.441871:0:15108:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008f31c5a3/0xc6b8ac1b0916335 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d88 expref: 8 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.441880:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843355.441885:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788843355.441890:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3e8f20b/0xc6b8ac1b091633c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.441960:0:15108:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008f31c5a3/0xc6b8ac1b0916335 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d88 expref: 8 pid: 15105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.441978:0:15108:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008f31c5a3/0xc6b8ac1b0916335 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d88 expref: 8 pid: 15105 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843355.441996:0:15108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43783800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15108:1875737795732992:192.168.203.29@tcp:104: 00000100:00100000:1.0:1788843355.442259:0:15108:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab43b4e000 going to sleep for 11 seconds 00000100:00100000:1.0:1788843355.444850:0:15108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43783800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15108:1875737795732992:192.168.203.29@tcp:104: 00010000:00010000:1.0:1788843355.444893:0:15108:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e3e8f20b/0xc6b8ac1b091633c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843355.447497:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843355.447697:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775828992 00000100:00100000:0.0:1788843355.447709:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775828992 00010000:00010000:0.0:1788843355.447764:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008f31c5a3/0xc6b8ac1b0916335 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d88 expref: 9 pid: 15105 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843355.447836:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 14 00000100:00100000:0.0:1788843355.447857:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+9:2359:x1875737775828992:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788843355.447879:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788843355.447911:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008f31c5a3/0xc6b8ac1b0916335 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d88 expref: 9 pid: 15105 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.447928:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008f31c5a3/0xc6b8ac1b0916335 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d88 expref: 9 pid: 15105 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.447956:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f31c5a3/0xc6b8ac1b0916335 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d88 expref: 9 pid: 15105 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.447978:0:14405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788843355.447983:0:14405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788843355.448012:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3e8f20b/0xc6b8ac1b091633c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.448024:0:14405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3e8f20b/0xc6b8ac1b091633c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.448283:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788843355.448415:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce70380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+8:2359:x1875737775828992:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 559us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788843355.448426:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 14 00010000:00010000:3.0:1788843355.450245:0:15108:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e3e8f20b/0xc6b8ac1b091633c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.450269:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3e8f20b/0xc6b8ac1b091633c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.450317:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e3e8f20b/0xc6b8ac1b091633c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.450326:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3e8f20b/0xc6b8ac1b091633c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.450397:0:15108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3e8f20b/0xc6b8ac1b091633c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.450404:0:15108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843355.450409:0:15108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3e8f20b/0xc6b8ac1b091633c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.450420:0:15108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3e8f20b/0xc6b8ac1b091633c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.450446:0:15108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3e8f20b/0xc6b8ac1b091633c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.450467:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3e8f20b/0xc6b8ac1b091633c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843355.450612:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b87c6d43-928f-4231-aaff-6c642a37da7f+7:2356:x1875737775828864:12345-192.168.203.29@tcp:1:lhsmtool_posix.0 Request processed in 8838us (9387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843355.450623:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:2.0:1788843355.457182:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843355.461002:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775829248 00000100:00100000:1.0:1788843355.461024:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775829248 00000100:00100000:1.0:1788843355.461947:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 53 00000100:00100000:1.0:1788843355.461964:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+14:14503:x1875737775829248:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788843355.462691:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0916343 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.462716:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0916343 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.462730:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0916343 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.465298:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091634a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.465333:0:14421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916312 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d73 expref: 15 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.465366:0:14421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091634a lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.465424:0:14421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916312 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d73 expref: 15 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.465444:0:14421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916312 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d73 expref: 15 pid: 14420 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843355.466163:0:14421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14421:1875737795733120:192.168.203.29@tcp:104: 00000100:00100000:0.0:1788843355.466308:0:14421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69916540 going to sleep for 11 seconds 00000100:00100000:0.0:1788843355.469540:0:14421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14421:1875737795733120:192.168.203.29@tcp:104: 00010000:00010000:0.0:1788843355.469604:0:14421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091634a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843355.472641:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843355.477133:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775829376 00000100:00100000:3.0:1788843355.477155:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775829376 00010000:00010000:3.0:1788843355.477225:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916312 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d73 expref: 16 pid: 14420 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843355.477269:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 15 00000100:00100000:3.0:1788843355.477301:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+16:2358:x1875737775829376:12345-192.168.203.29@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788843355.477322:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788843355.477330:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916312 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d73 expref: 16 pid: 14420 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.477373:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916312 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d73 expref: 16 pid: 14420 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.477401:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375c00/0xc6b8ac1b0916312 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.29@tcp remote: 0x34e059c607084d73 expref: 16 pid: 14420 timeout: 579 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.477424:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:3.0:1788843355.477430:0:14406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091634a lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.477442:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091634a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.477450:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091634a lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.477495:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788843355.477662:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+15:2358:x1875737775829376:12345-192.168.203.29@tcp:103:ldlm_bl.0 Request processed in 362us (5035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843355.477671:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 15 00010000:00010000:1.0:1788843355.477695:0:14421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091634a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.477707:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091634a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788843355.479797:0:14421:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1788843355.480380:0:14421:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1788843355.480439:0:14421:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1788843355.480709:0:14421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7ce71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14421:1875737795733248:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788843355.483010:0:14421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843355.483151:0:14421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab51b15540 going to sleep for 11 seconds 00000100:00100000:1.0:1788843355.496029:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795733248 00000100:00100000:1.0:1788843355.496051:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795733248 00000100:00100000:1.0:1788843355.496110:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788843355.496120:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14421:x1875737795733248:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788843355.496236:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14421:x1875737795733248:12345-0@lo:1000:mdt00_001.0 Request processed in 118us (13240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843355.496243:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788843355.496407:0:14421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7ce71c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14421:1875737795733248:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788843355.497087:0:14421:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1788843355.497176:0:14421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14421:1875737795733376:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788843355.497237:0:14421:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788843355.497271:0:14421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69916180 going to sleep for 11 seconds 00000100:00100000:1.0:1788843355.497407:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795733376 00000100:00100000:1.0:1788843355.497413:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795733376 00000100:00100000:1.0:1788843355.497454:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788843355.497463:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14421:x1875737795733376:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788843355.497620:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14421:x1875737795733376:12345-0@lo:1000:mdt00_001.0 Request processed in 158us (384us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788843355.497627:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788843355.498703:0:14421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc1df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14421:1875737795733376:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788843355.498754:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091634a lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.498769:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091634a lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.498776:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091634a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.498781:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42697000 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843355.498786:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091634a lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.498794:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091634a lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.498809:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:0.0:1788843355.498812:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788843355.498817:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091634a lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.498840:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42697000/0xc6b8ac1b091634a lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.498875:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09162a2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.498880:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09162a2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.498886:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09162a2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.498890:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab49375400 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843355.498893:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09162a2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.498899:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09162a2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.498907:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:0.0:1788843355.498909:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788843355.498917:0:14421:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09162a9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d57 expref: 18 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.498929:0:14421:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09162a9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d57 expref: 18 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.498937:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09162a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d57 expref: 18 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.500518:0:14421:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49374c00/0xc6b8ac1b09162a9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.29@tcp remote: 0x34e059c607084d57 expref: 18 pid: 15380 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843355.500539:0:14421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7fc1c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14421:1875737795733504:192.168.203.29@tcp:105: 00000100:00100000:0.0:1788843355.500693:0:14421:0:(client.c:2715:ptlrpc_set_wait()) set ffff8dab69916240 going to sleep for 11 seconds 00000100:00100000:2.0:1788843355.504242:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843355.504318:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775829504 00000100:00100000:3.0:1788843355.504327:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775829504 00000100:00100000:3.0:1788843355.504416:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:3.0:1788843355.504428:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7c053c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+19:14502:x1875737775829504:12345-192.168.203.29@tcp:49:dd.0 00000100:00100000:3.0:1788843355.504599:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7c053c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+19:14502:x1875737775829504:12345-192.168.203.29@tcp:49:dd.0 Request processed in 173us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788843355.504607:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 10 00000100:00100000:0.0:1788843355.507573:0:14421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7fc1c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14421:1875737795733504:192.168.203.29@tcp:105: 00010000:00010000:0.0:1788843355.507616:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09162a2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.507627:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab49375400/0xc6b8ac1b09162a2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.507664:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916351 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.507678:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916351 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.507689:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916351 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.507699:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916351 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.507705:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916351 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.507711:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916351 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.507734:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696600 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843355.507739:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916351 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.507745:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916351 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.507759:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:0.0:1788843355.507762:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788843355.507766:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916351 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.507771:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8daa42696600/0xc6b8ac1b0916351 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.507782:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0916343 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.507789:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0916343 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.507794:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0916343 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.507799:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933b600 already unused, calling callback (ffffffffc1e714f0) 00010000:00010000:0.0:1788843355.507802:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0916343 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.507809:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0916343 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.507827:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dab61f39500) 00010000:00010000:0.0:1788843355.507829:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788843355.507832:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0916343 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.507838:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab4933b600/0xc6b8ac1b0916343 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843355.508108:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b87c6d43-928f-4231-aaff-6c642a37da7f+18:14503:x1875737775829248:12345-192.168.203.29@tcp:57:lhsmtool_posix.0 Request processed in 46147us (50940us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788843355.508119:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 53 00000020:00080000:0.0:1788843355.508126:0:14421:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788843355.509514:0:14455:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788843355.509521:0:14455:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788843355.509547:0:14455:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788843355.509553:0:14455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788843355.512574:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:3.0:1788843355.512789:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775829760 00000100:00100000:3.0:1788843355.512799:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775829760 00000100:00100000:3.0:1788843355.512854:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 11 00000100:00100000:3.0:1788843355.512864:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+18:14503:x1875737775829760:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788843355.513562:0:14423:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788843355.518817:0:14423:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788843355.519753:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0916358 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.519773:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0916358 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.519784:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0916358 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.519794:0:14423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0916358 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.519801:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0916358 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.519808:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0916358 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.519831:0:14423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788843355.520253:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788843355.520261:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0916358 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.520280:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88e00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843355.520285:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0916358 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.520292:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0916358 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.520304:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dab54910b00) 00010000:00010000:1.0:1788843355.520307:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788843355.520311:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0916358 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.520317:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dab7ff88e00/0xc6b8ac1b0916358 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.520330:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843355.520332:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788843355.520334:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788843355.521079:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+20:14503:x1875737775829760:12345-192.168.203.29@tcp:35:lhsmtool_posix.0 Request processed in 8210us (8509us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788843355.521096:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 11 00000020:00080000:2.0:1788843355.521104:0:14423:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788843355.689496:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843355.689616:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775829888 00000100:00100000:0.0:1788843355.689627:0:15111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775829888 00000100:00100000:0.0:1788843355.689736:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:0.0:1788843355.689747:0:15111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7ce71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+7:2359:x1875737775829888:12345-192.168.203.29@tcp:4:dd.0 00002000:00010000:0.0:1788843355.689800:0:15111:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9f955a, atime: 0x6a9f9559, ctime: 0x6a9f955a, blocks: 0x1 00010000:00010000:0.0:1788843355.689810:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b091635f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.689828:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=479s v=(0 0) 00010000:00010000:0.0:1788843355.689833:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843355.689840:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b091635f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.689855:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b091635f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843355.693437:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843355.695796:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788843355.697939:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843355.700071:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788843355.702864:0:15113:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788843355.703697:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843355.705887:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775830016 00000100:00100000:2.0:1788843355.705902:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775830016 00000100:00100000:2.0:1788843355.705973:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788843355.705993:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775830144 00000100:00100000:2.0:1788843355.705996:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775830144 00000100:00100000:3.0:1788843355.709011:0:16656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:3.0:1788843355.709029:0:16656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab6e848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+10:2359:x1875737775830016:12345-192.168.203.29@tcp:4:dd.0 00010000:00010000:3.0:1788843355.709077:0:16656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0916366 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.709095:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843355.709100:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843355.709106:0:16656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0916366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.709122:0:16656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0916366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843355.710196:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843355.714752:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788843355.719105:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1788843355.719388:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775830272 00000100:00100000:2.0:1788843355.719399:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775830272 00000100:00100000:2.0:1788843355.719455:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1788843355.719463:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775830400 00000100:00100000:2.0:1788843355.719466:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775830400 00000100:00100000:2.0:1788843355.720415:0:16657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:2.0:1788843355.720431:0:16657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b87c6d43-928f-4231-aaff-6c642a37da7f+13:2359:x1875737775830144:12345-192.168.203.29@tcp:4:dd.0 00010000:00010000:2.0:1788843355.720469:0:16657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000738e427b/0xc6b8ac1b091636d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.720487:0:16657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843355.720492:0:16657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843355.720499:0:16657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000738e427b/0xc6b8ac1b091636d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.720512:0:16657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000738e427b/0xc6b8ac1b091636d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843355.726857:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843355.726896:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843355.726946:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843355.726968:0:15112:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1788843355.727134:0:15112:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1788843355.727217:0:15113:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1788843355.727225:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775830528 00000100:00100000:0.0:1788843355.727233:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775830528 00000100:00100000:0.0:1788843355.727290:0:15113:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1788843355.727297:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775830656 00000100:00100000:0.0:1788843355.727299:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775830656 00000100:00100000:0.0:1788843355.727313:0:15113:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1788843355.727318:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775830784 00000100:00100000:0.0:1788843355.727320:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775830784 00010000:00010000:2.0:1788843355.729122:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843355.730424:0:16658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:0.0:1788843355.730442:0:16658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b87c6d43-928f-4231-aaff-6c642a37da7f+17:2359:x1875737775830272:12345-192.168.203.29@tcp:4:dd.0 00010000:00010000:0.0:1788843355.730483:0:16658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dc200d8/0xc6b8ac1b0916374 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.730501:0:16658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843355.730506:0:16658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843355.730513:0:16658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003dc200d8/0xc6b8ac1b0916374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.730528:0:16658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003dc200d8/0xc6b8ac1b0916374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843355.824361:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:0.0:1788843355.824379:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:0.0:1788843355.824385:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:0.0:1788843355.824738:0:15111:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:0.0:1788843355.824742:0:15111:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788843354 -> 1788843355 00002000:00010000:0.0:1788843355.824745:0:15111:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788843354 -> 1788843355 00002000:00010000:0.0:1788843355.824747:0:15111:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1788843355.824763:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b091635f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.824777:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b091635f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.824786:0:15111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b091635f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.824803:0:15111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696600 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843355.824808:0:15111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b091635f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.824818:0:15111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b091635f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.824841:0:15111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b091635f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.824865:0:15111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c02dc60/0xc6b8ac1b091635f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843355.824948:0:15111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7ce71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+19:2359:x1875737775829888:12345-192.168.203.29@tcp:4:dd.0 Request processed in 135200us (135457us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788843355.824958:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 0 00000100:00100000:0.0:1788843355.825003:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 4 00000100:00100000:0.0:1788843355.825022:0:15111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+18:2358:x1875737775830400:12345-192.168.203.29@tcp:4:dd.0 00010000:00010000:0.0:1788843355.825070:0:15111:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1ff40d7/0xc6b8ac1b091637b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.825082:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788843355.825087:0:15111:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788843355.825093:0:15111:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1ff40d7/0xc6b8ac1b091637b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.825104:0:15111:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1ff40d7/0xc6b8ac1b091637b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788843355.892310:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1788843355.892615:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:3.0:1788843355.896862:0:16657:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:3.0:1788843355.896871:0:16657:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 10247 00010000:00010000:3.0:1788843355.896885:0:16657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000738e427b/0xc6b8ac1b091636d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.896910:0:16657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000738e427b/0xc6b8ac1b091636d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.896920:0:16657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000738e427b/0xc6b8ac1b091636d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.896927:0:16657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843355.896932:0:16657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000738e427b/0xc6b8ac1b091636d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.896941:0:16657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000738e427b/0xc6b8ac1b091636d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.896960:0:16657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000738e427b/0xc6b8ac1b091636d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.896967:0:16657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000738e427b/0xc6b8ac1b091636d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843355.897063:0:16657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b87c6d43-928f-4231-aaff-6c642a37da7f+16:2359:x1875737775830144:12345-192.168.203.29@tcp:4:dd.0 Request processed in 176632us (199131us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1788843355.897074:0:16657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 2 00000100:00100000:3.0:1788843355.897110:0:16657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 5 00000100:00100000:3.0:1788843355.897122:0:16657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b87c6d43-928f-4231-aaff-6c642a37da7f+15:2358:x1875737775830528:12345-192.168.203.29@tcp:4:dd.0 00010000:00010000:3.0:1788843355.897149:0:16657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0916382 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.897167:0:16657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843355.897171:0:16657:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788843355.897177:0:16657:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0916382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.897194:0:16657:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0916382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.899160:0:16656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0916366 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.899177:0:16656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0916366 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.899186:0:16656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0916366 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.899191:0:16656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82054a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:1.0:1788843355.899206:0:16656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0916366 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.899216:0:16656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0916366 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.899249:0:16656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0916366 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.899257:0:16656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c87a0644/0xc6b8ac1b0916366 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788843355.899364:0:16656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab6e848a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+15:2359:x1875737775830016:12345-192.168.203.29@tcp:4:dd.0 Request processed in 190315us (205912us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788843355.899375:0:16656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 1 00000100:00100000:1.0:1788843355.899409:0:16656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 6 00000100:00100000:1.0:1788843355.899420:0:16656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+14:2359:x1875737775830656:12345-192.168.203.29@tcp:4:dd.0 00010000:00010000:1.0:1788843355.899450:0:16656:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb986849/0xc6b8ac1b0916389 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.899461:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843355.899466:0:16656:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788843355.899472:0:16656:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb986849/0xc6b8ac1b0916389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788843355.899482:0:16656:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb986849/0xc6b8ac1b0916389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.904315:0:16658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003dc200d8/0xc6b8ac1b0916374 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.904337:0:16658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003dc200d8/0xc6b8ac1b0916374 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.904412:0:16658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003dc200d8/0xc6b8ac1b0916374 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.904437:0:16658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696000 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843355.904442:0:16658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003dc200d8/0xc6b8ac1b0916374 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.904458:0:16658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003dc200d8/0xc6b8ac1b0916374 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.904479:0:16658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003dc200d8/0xc6b8ac1b0916374 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.904487:0:16658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003dc200d8/0xc6b8ac1b0916374 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843355.904582:0:16658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b87c6d43-928f-4231-aaff-6c642a37da7f+14:2359:x1875737775830272:12345-192.168.203.29@tcp:4:dd.0 Request processed in 174142us (200886us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788843355.904592:0:16658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 3 00000100:00100000:2.0:1788843355.904623:0:16658:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 7 00000100:00100000:2.0:1788843355.904635:0:16658:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b87c6d43-928f-4231-aaff-6c642a37da7f+13:2359:x1875737775830784:12345-192.168.203.29@tcp:4:dd.0 00010000:00010000:2.0:1788843355.904667:0:16658:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b0916390 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.904679:0:16658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843355.904684:0:16658:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788843355.904690:0:16658:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b0916390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.904716:0:16658:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b0916390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788843355.929582:0:15111:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00010000:00010000:0.0:1788843355.929603:0:15111:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1ff40d7/0xc6b8ac1b091637b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.929631:0:15111:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1ff40d7/0xc6b8ac1b091637b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.929640:0:15111:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1ff40d7/0xc6b8ac1b091637b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.929647:0:15111:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8daa42696200 already unused, calling callback (ffffffffc1420420) 00010000:00010000:0.0:1788843355.929652:0:15111:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1ff40d7/0xc6b8ac1b091637b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.929660:0:15111:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1ff40d7/0xc6b8ac1b091637b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.929680:0:15111:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1ff40d7/0xc6b8ac1b091637b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788843355.929688:0:15111:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1ff40d7/0xc6b8ac1b091637b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15111 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788843355.929772:0:15111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b87c6d43-928f-4231-aaff-6c642a37da7f+17:2358:x1875737775830400:12345-192.168.203.29@tcp:4:dd.0 Request processed in 104750us (219577us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1788843355.929781:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 4 00000001:00080000:0.0:1788843355.929814:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:1.0:1788843355.970675:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:2.0:1788843355.971465:0:16657:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:2.0:1788843355.971472:0:16657:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:2.0:1788843355.971486:0:16657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0916382 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.971498:0:16657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0916382 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.971507:0:16657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0916382 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.971513:0:16657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab82055e00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:2.0:1788843355.971518:0:16657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0916382 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.971526:0:16657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0916382 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.971545:0:16657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0916382 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788843355.971552:0:16657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033823beb/0xc6b8ac1b0916382 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843355.971655:0:16657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b87c6d43-928f-4231-aaff-6c642a37da7f+11:2358:x1875737775830528:12345-192.168.203.29@tcp:4:dd.0 Request processed in 74533us (244802us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788843355.971666:0:16657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 5 00002000:00010000:3.0:1788843355.972662:0:16656:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1788843355.972677:0:16656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb986849/0xc6b8ac1b0916389 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.972687:0:16656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb986849/0xc6b8ac1b0916389 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.972695:0:16656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb986849/0xc6b8ac1b0916389 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.972701:0:16656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab4933a400 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843355.972704:0:16656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb986849/0xc6b8ac1b0916389 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.972712:0:16656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb986849/0xc6b8ac1b0916389 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.972725:0:16656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb986849/0xc6b8ac1b0916389 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843355.972741:0:16656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb986849/0xc6b8ac1b0916389 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16656 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788843355.973649:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795733760:0@lo:400:kworker.0 00000100:00100000:2.0:1788843355.973700:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843355.973743:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795734272:0@lo:400:kworker.0 00000100:00100000:2.0:1788843355.973766:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843355.973849:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788843355.973857:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795733888:0@lo:400:kworker.0 00000100:00100000:2.0:1788843355.973880:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788843355.973922:0:16114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795733760 00000100:00100000:2.0:1788843355.973928:0:16114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795733760 00000100:00100000:2.0:1788843355.973960:0:16114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795733888 00000100:00100000:2.0:1788843355.973963:0:16114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795733888 00000100:00100000:2.0:1788843355.973988:0:16114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788843355.973996:0:16114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795733760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843355.974050:0:16114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795733760:12345-0@lo:400:kworker.0 Request processed in 43us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843355.974058:0:16114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788843355.974074:0:16114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788843355.974080:0:16114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795733888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788843355.974106:0:16114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875737795733888:12345-0@lo:400:kworker.0 Request processed in 26us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843355.974111:0:16114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788843355.974140:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788843355.974171:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795733888:0@lo:400:kworker.0 00000100:00100000:2.0:1788843355.974179:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788843355.974184:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dab7ce73480, transno 8589934595 00000004:00080000:2.0:1788843355.974194:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788843355.974214:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1875737795733760:0@lo:400:kworker.0 00000100:00100000:1.0:1788843355.976080:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab7bc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:845ba2f4-9198-464f-ba29-11072ff30647:3305:1875737795733632:0@lo:400:kworker.0 00000100:00100000:1.0:1788843355.976144:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843355.976179:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795734144:0@lo:400:kworker.0 00000100:00100000:1.0:1788843355.976204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843355.976229:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788843355.976235:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab73a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795734016:0@lo:400:kworker.0 00000100:00100000:1.0:1788843355.976256:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843355.976287:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795734272 00000100:00100000:1.0:1788843355.976293:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795734272 00000100:00100000:1.0:1788843355.976368:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795734144 00000100:00100000:1.0:1788843355.976371:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795734144 00000100:00100000:1.0:1788843355.976386:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795734016 00000100:00100000:1.0:1788843355.976389:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795734016 00000100:00100000:1.0:1788843355.976402:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788843355.976411:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab73a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795734272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843355.976461:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab73a79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875737795734272:12345-0@lo:400:kworker.0 Request processed in 50us (2692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843355.976467:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788843355.976483:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843355.976489:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795734144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843355.976518:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43783800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875737795734144:12345-0@lo:400:kworker.0 Request processed in 28us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843355.976523:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788843355.976535:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843355.976550:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795734016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843355.976578:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43782d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875737795734016:12345-0@lo:400:kworker.0 Request processed in 29us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843355.976583:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788843355.976659:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795733632 00000100:00100000:1.0:1788843355.976664:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795733632 00000100:00100000:1.0:1788843355.976698:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788843355.976706:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+19:3305:x1875737795733632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788843355.976743:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:845ba2f4-9198-464f-ba29-11072ff30647+19:3305:x1875737795733632:12345-0@lo:400:kworker.0 Request processed in 37us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843355.976750:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788843355.976786:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8dab43780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795734400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843355.976811:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788843355.976837:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737795734400 00000100:00100000:1.0:1788843355.976840:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737795734400 00000100:00100000:1.0:1788843355.976861:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788843355.976866:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795734400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788843355.976889:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788843355.976923:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43783b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875737795734400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843355.976928:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788843355.976946:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788843355.976975:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab43780000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1875737795734400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788843355.976998:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875737795734016:0@lo:400:kworker.0 00000100:00100000:1.0:1788843355.977005:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab7bc47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:845ba2f4-9198-464f-ba29-11072ff30647:3305:1875737795733632:0@lo:400:kworker.0 00000100:00100000:1.0:1788843355.977021:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1875737795734144:0@lo:400:kworker.0 00000100:00100000:1.0:1788843355.977066:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8dab73a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1875737795734272:0@lo:400:kworker.0 00000100:00100000:3.0:1788843355.980178:0:16656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+9:2359:x1875737775830656:12345-192.168.203.29@tcp:4:dd.0 Request processed in 80749us (253269us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1788843355.980193:0:16656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 6 00000001:00080000:1.0:1788843356.008885:0:6719:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:3.0:1788843356.009301:0:16658:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b0916390 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843356.009318:0:16658:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b0916390 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843356.009327:0:16658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b0916390 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843356.009334:0:16658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dab7ff88a00 already unused, calling callback (ffffffffc1420420) 00010000:00010000:3.0:1788843356.009339:0:16658:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b0916390 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843356.009369:0:16658:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b0916390 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843356.009388:0:16658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b0916390 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788843356.009412:0:16658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050853035/0xc6b8ac1b0916390 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16658 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788843356.009518:0:16658:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2359:x1875737775830784:12345-192.168.203.29@tcp:4:dd.0 Request processed in 104883us (282567us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788843356.009528:0:16658:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 7 00010000:00010000:1.0:1788843356.740695:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788843357.758806:0:16695:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788843357.785446:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788843357.844261:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:0.0:1788843357.844313:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843357.844322:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775830912 00000100:00100000:1.0:1788843357.844332:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775830912 00000100:00100000:0.0:1788843357.844377:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843357.844403:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 124 00000100:00100000:0.0:1788843357.844411:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843357.844419:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab81e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+13:2356:x1875737775830912:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:0.0:1788843357.844453:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843357.844515:0:16114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775831168 00000100:00100000:2.0:1788843357.844521:0:16114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775831168 00000100:00100000:2.0:1788843357.844554:0:16114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775831680 00000100:00100000:2.0:1788843357.844557:0:16114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775831680 00000100:00100000:2.0:1788843357.844577:0:16114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:2.0:1788843357.844585:0:16114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2356:x1875737775831168:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843357.844636:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab81e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:80593374-1a93-4bf4-84d9-50ccd339dd04+13:2356:x1875737775830912:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 221us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843357.844645:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 124 00000100:00100000:1.0:1788843357.844680:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775831424 00000100:00100000:1.0:1788843357.844684:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775831424 00000100:00100000:1.0:1788843357.844707:0:15380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775831040 00000100:00100000:1.0:1788843357.844710:0:15380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775831040 00000100:00100000:1.0:1788843357.844729:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:1.0:1788843357.844736:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:2356:x1875737775831424:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843357.847746:0:16114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2356:x1875737775831168:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 3149us (3420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843357.847761:0:16114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 17 00000100:00100000:2.0:1788843357.847794:0:16114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:2.0:1788843357.847805:0:16114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57dd4253-596f-4283-9b4c-1047ff1bcc24+5:2356:x1875737775831680:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843357.847853:0:16114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57dd4253-596f-4283-9b4c-1047ff1bcc24+5:2356:x1875737775831680:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 52us (3446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843357.847858:0:16114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 18 00000100:00100000:1.0:1788843357.848506:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:57dd4253-596f-4283-9b4c-1047ff1bcc24+6:2356:x1875737775831424:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 3767us (4127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843357.848517:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 30 00000100:00100000:1.0:1788843357.848540:0:15380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00100000:1.0:1788843357.848548:0:15380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab7fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+20:2356:x1875737775831040:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:1.0:1788843357.848581:0:15380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab7fc1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+20:2356:x1875737775831040:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 36us (4141us total) trans 0 rc 0/0 00000100:00100000:1.0:1788843357.848719:0:15380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 31 00000100:00080000:1.0:1788843357.848748:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788843357.848753:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788843357.848756:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788843357.853496:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:1.0:1788843357.853539:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.29@tcp (source: 12345-192.168.203.29@tcp) 00000100:00100000:2.0:1788843357.853811:0:16114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775831296 00000100:00100000:2.0:1788843357.853822:0:16114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775831296 00000100:00100000:2.0:1788843357.853885:0:16114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875737775831552 00000100:00100000:2.0:1788843357.853889:0:16114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875737775831552 00000100:00100000:2.0:1788843357.853920:0:16114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:2.0:1788843357.853931:0:16114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2356:x1875737775831296:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843357.854014:0:16114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43780000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b87c6d43-928f-4231-aaff-6c642a37da7f+5:2356:x1875737775831296:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 85us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843357.854022:0:16114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 19 00000100:00100000:2.0:1788843357.854049:0:16114:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00100000:2.0:1788843357.854055:0:16114:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8dab43781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57dd4253-596f-4283-9b4c-1047ff1bcc24+5:2356:x1875737775831552:12345-192.168.203.29@tcp:400:kworker.0 00000100:00100000:2.0:1788843357.854081:0:16114:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8dab43781180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:57dd4253-596f-4283-9b4c-1047ff1bcc24+5:2356:x1875737775831552:12345-192.168.203.29@tcp:400:kworker.0 Request processed in 26us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788843357.854092:0:16114:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.29@tcp, seq: 20 00000100:00080000:1.0:1788843357.854240:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788843357.854245:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788843358.788904:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29510 lines, 29510 kept, 0 dropped, 0 bad.